paper-with-me

Papers

Multi-Stream Perturbation Attack: Breaking Safety Alignment of Thinking LLMs Through Concurrent Task Interference

2026-03-10 · Fan Yang arxiv

The widespread adoption of thinking mode in large language models (LLMs) has significantly enhanced complex task processing capabilities while introducing new security risks. When subjected to jailbreak attacks, the step-by-step reasoning process may cause models to generate more detailed harmful content. We observe that thinking mode exhibits unique vulnerabilities when processing interleaved multiple tasks. Based on this observation, we propose multi-stream perturbation attack, which generates superimposed interference by interweaving multiple task streams within a single prompt. We design three perturbation strategies: multi-stream interleaving, inversion perturbation, and shape transformation, which disrupt the thinking process through concurrent task interleaving, character reversal, and format constraints respectively. On JailbreakBench, AdvBench, and HarmBench datasets, our method achieves attack success rates exceeding most methods across mainstream models including Qwen3 series, DeepSeek, Qwen3-Max, and Gemini 2.5 Flash. Experiments show thinking collapse rates and response repetition rates reach up to 17% and 60% respectively, indicating multi-stream perturbation not only bypasses safety mechanisms but also causes thinking process collapse or repetitive outputs.

📄 PDF Abstract BibTeX arXiv:2603.10091

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models

2024-05-14 · Raghuveer Peri, Sai Muralidhar Jayanthi, Srikanth Ronanki, Anshu Bhatia 외

Integrated Speech and Large Language Models (SLMs) that can follow speech instructions and generate relevant text responses have gained popularity lately. However, the safety and robustness of these models remains largel…

Adversarial RobustnessInstruction FollowingQuestion Answering

JaiLIP: Jailbreaking Vision-Language Models via Loss Guided Image Perturbation

2025-09-24 · Md Jueal Mia, M. Hadi Amini arxiv

Vision-Language Models (VLMs) have remarkable abilities in generating multimodal reasoning tasks. However, potential misuse or safety alignment concerns of VLMs have increased significantly due to different categories of…

Multimodal ReasoningText Generation

BitBypass: A New Direction in Jailbreaking Aligned Large Language Models with Bitstream Camouflage

2025-06-03 · Kalyan Nakka, Nitesh Saxena

The inherent risk of generating harmful and unsafe content by Large Language Models (LLMs), has highlighted the need for their safety alignment. Various techniques like supervised fine-tuning, reinforcement learning from…

Prompt EngineeringRed TeamingSafety Alignment

RAG-Pull: Turning Retrieval into a Code-Injection Channel via Invisible Unicode Perturbations

2025-10-13 · Aritra Dhar, Vasilije Stambolic, Lukas Cavigelli arxiv

Retrieval-Augmented Generation (RAG) increases the reliability and trustworthiness of the LLM response and reduces hallucination by eliminating the need for model retraining. It does so by adding external data into the L…

Robust LLM safeguarding via refusal feature adversarial training

2024-09-30 · Lei Yu, Virginie Do, Karen Hambardzumyan, Nicola Cancedda

Large language models (LLMs) are vulnerable to adversarial attacks that can elicit harmful responses. Defending against such attacks remains challenging due to the opacity of jailbreaking mechanisms and the high computat…