paper-with-me

Papers

BitBypass: A New Direction in Jailbreaking Aligned Large Language Models with Bitstream Camouflage

2025-06-03 · Kalyan Nakka, Nitesh Saxena

The inherent risk of generating harmful and unsafe content by Large Language Models (LLMs), has highlighted the need for their safety alignment. Various techniques like supervised fine-tuning, reinforcement learning from human feedback, and red-teaming were developed for ensuring the safety alignment of LLMs. However, the robustness of these aligned LLMs is always challenged by adversarial attacks that exploit unexplored and underlying vulnerabilities of the safety alignment. In this paper, we develop a novel black-box jailbreak attack, called BitBypass, that leverages hyphen-separated bitstream camouflage for jailbreaking aligned LLMs. This represents a new direction in jailbreaking by exploiting fundamental information representation of data as continuous bits, rather than leveraging prompt engineering or adversarial manipulations. Our evaluation of five state-of-the-art LLMs, namely GPT-4o, Gemini 1.5, Claude 3.5, Llama 3.1, and Mixtral, in adversarial perspective, revealed the capabilities of BitBypass in bypassing their safety alignment and tricking them into generating harmful and unsafe content. Further, we observed that BitBypass outperforms several state-of-the-art jailbreak attacks in terms of stealthiness and attack success. Overall, these results highlights the effectiveness and efficiency of BitBypass in jailbreaking these state-of-the-art LLMs.

📄 PDF Abstract BibTeX arXiv:2506.02479

Code (1)

kalyan-nakka/bitbypass 공식 구현

Tasks

Prompt EngineeringRed TeamingSafety Alignment

Methods 이 논문이 사용한 방법론

LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…

Similar Papers 제목 키워드 기반

Evaluating Jailbreaking Vulnerabilities in LLMs Deployed as Assistants for Smart Grid Operations: A Benchmark Against NERC Standards

2026-04-25 · Taha Hammadia, Lucas Rea, Ahmad Mohammad Saber, Amr Youssef 외 arxiv

The deployment of Large Language Models (LLMs) as assistants in electric grid operations promises to streamline compliance and decision-making but exposes new vulnerabilities to prompt-based adversarial attacks. This pap…

Faster-GCG: Efficient Discrete Optimization Jailbreak Attacks against Aligned Large Language Models

2024-10-20 · Xiao Li, Zhuhong Li, Qiongxiu Li, Bingze Lee 외

Aligned Large Language Models (LLMs) have demonstrated remarkable performance across various tasks. However, LLMs remain susceptible to jailbreak adversarial attacks, where adversaries manipulate prompts to elicit malici…

Directional Embedding Smoothing for Robust Vision Language Models

2026-03-16 · Ye Wang, Jing Liu, Toshiaki Koike-Akino arxiv

The safety and reliability of vision-language models (VLMs) are a crucial part of deploying trustworthy agentic AI systems. However, VLMs remain vulnerable to jailbreaking attacks that undermine their safety alignment to…

Adversarial Reasoning at Jailbreaking Time

2025-02-03 · Mahdi Sabbaghi, Paul Kassianik, George Pappas, Yaron Singer 외

As large language models (LLMs) are becoming more capable and widespread, the study of their failure cases is becoming increasingly important. Recent advances in standardizing, measuring, and scaling test-time compute su…

Adversarial Robustness

What is in Your Safe Data? Identifying Benign Data that Breaks Safety

2024-04-01 · Luxi He, Mengzhou Xia, Peter Henderson

Current Large Language Models (LLMs), even those tuned for safety and alignment, are susceptible to jailbreaking. Some have found that just further fine-tuning an aligned model with benign data (i.e., data without harmfu…

Math