paper-with-me

홈 › Papers

InfoFlood: Jailbreaking Large Language Models with Information Overload

2025-06-13 · Advait Yadav, Haibo Jin, Man Luo, Jun Zhuang, Haohan Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains. However, their potential to generate harmful responses has raised significant societal and regulatory concerns, especially when manipulated by adversarial techniques known as "jailbreak" attacks. Existing jailbreak methods typically involve appending carefully crafted prefixes or suffixes to malicious prompts in order to bypass the built-in safety mechanisms of these models. In this work, we identify a new vulnerability in which excessive linguistic complexity can disrupt built-in safety mechanisms-without the need for any added prefixes or suffixes-allowing attackers to elicit harmful outputs directly. We refer to this phenomenon as Information Overload. To automatically exploit this vulnerability, we propose InfoFlood, a jailbreak attack that transforms malicious queries into complex, information-overloaded queries capable of bypassing built-in safety mechanisms. Specifically, InfoFlood: (1) uses linguistic transformations to rephrase malicious queries, (2) identifies the root cause of failure when an attempt is unsuccessful, and (3) refines the prompt's linguistic structure to address the failure while preserving its malicious intent. We empirically validate the effectiveness of InfoFlood on four widely used LLMs-GPT-4o, GPT-3.5-turbo, Gemini 2.0, and LLaMA 3.1-by measuring their jailbreak success rates. InfoFlood consistently outperforms baseline attacks, achieving up to 3 times higher success rates across multiple jailbreak benchmarks. Furthermore, we demonstrate that commonly adopted post-processing defenses, including OpenAI's Moderation API, Perspective API, and SmoothLLM, fail to mitigate these attacks. This highlights a critical weakness in traditional AI safety guardrails when confronted with information overload-based jailbreaks.

📄 PDF Abstract BibTeX arXiv:2506.12274

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…

Similar Papers 제목 키워드 기반

Cognitive Overload: Jailbreaking Large Language Models with Overloaded Logical Thinking

2023-11-16 · Nan Xu, Fei Wang, Ben Zhou, Bang Zheng Li 외

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from…

Safety Alignment

Overloading Large Vision-Language Models for Jailbreaking

2026-07-03 · Haoyu Zhang, Yangyang Guo, Mohan Kankanhalli arxiv

Large Vision-Language Models (LVLMs) exhibit remarkable vision-language capabilities and are increasingly deployed in real-world applications such as personal assistants, document analysis systems, and embodied agents. H…

Guarding the Guardrails: A Taxonomy-Driven Approach to Jailbreak Detection

2025-10-14 · Francesco Giarrusso, Olga E. Sorokoletova, Vincenzo Suriani, Daniele Nardi arxiv

Jailbreaking techniques pose a significant threat to the safety of Large Language Models (LLMs). Existing defenses typically focus on single-turn attacks, lack coverage across languages, and rely on limited taxonomies th…

Foot In The Door: Understanding Large Language Model Jailbreaking via Cognitive Psychology

2024-02-24 · Zhenhua Wang, Wei Xie, Baosheng Wang, Enze Wang 외

Large Language Models (LLMs) have gradually become the gateway for people to acquire new knowledge. However, attackers can break the model's security protection ("jail") to access restricted information, which is called …

Decision MakingLanguage ModelingLanguage ModellingLarge Language Model

Adaptive Jailbreaking Strategies Based on the Semantic Understanding Capabilities of Large Language Models

2025-05-29 · Mingyu Yu, Wei Wang, Yanjie Wei, Sujuan Qin

Adversarial attacks on Large Language Models (LLMs) via jailbreaking techniques-methods that circumvent their built-in safety and ethical constraints-have emerged as a critical challenge in AI security. These attacks com…