paper-with-me

홈 › Papers

Derail Yourself: Multi-turn LLM Jailbreak Attack through Self-discovered Clues

2024-10-14 · Qibing Ren, Hao Li, Dongrui Liu, Zhanxu Xie, Xiaoya Lu, Yu Qiao, Lei Sha, Junchi Yan, Lizhuang Ma, Jing Shao

This study exposes the safety vulnerabilities of Large Language Models (LLMs) in multi-turn interactions, where malicious users can obscure harmful intents across several queries. We introduce ActorAttack, a novel multi-turn attack method inspired by actor-network theory, which models a network of semantically linked actors as attack clues to generate diverse and effective attack paths toward harmful targets. ActorAttack addresses two main challenges in multi-turn attacks: (1) concealing harmful intents by creating an innocuous conversation topic about the actor, and (2) uncovering diverse attack paths towards the same harmful target by leveraging LLMs' knowledge to specify the correlated actors as various attack clues. In this way, ActorAttack outperforms existing single-turn and multi-turn attack methods across advanced aligned LLMs, even for GPT-o1. We will publish a dataset called SafeMTData, which includes multi-turn adversarial prompts and safety alignment data, generated by ActorAttack. We demonstrate that models safety-tuned using our safety dataset are more robust to multi-turn attacks. Code is available at https://github.com/renqibing/ActorAttack.

📄 PDF Abstract BibTeX arXiv:2410.10700

Code (2)

renqibing/actorattack 공식 구현
AIM-Intelligence/Automated-Multi-Turn-Jailbreaks

Tasks

LLM JailbreakSafety Alignment

Similar Papers 제목 키워드 기반

D-Judge: Disrupting Multi-Turn Jailbreaks using Semantics-Preserving Output Rewriting

2026-05-31 · Huanli Gong, Zhipeng Wei, Yu Fu, Haz Sameen Shahgir 외 arxiv

Multi-turn jailbreak attacks pose a growing threat to large language model (LLM) safety because they exploit feedback from auxiliary judge models to iteratively refine prompts toward harmful goals. Existing defenses larg…

Multi-Turn Jailbreaks Are Simpler Than They Seem

2025-08-11 · Xiaoxue Yang, Jaeha Lee, Anna-Katharina Dick, Jasper Timm 외 arxiv

While defenses against single-turn jailbreak attacks on Large Language Models (LLMs) have improved significantly, multi-turn jailbreaks remain a persistent vulnerability, often achieving success rates exceeding 70% again…

LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet

2024-08-27 · Nathaniel Li, Ziwen Han, Ian Steneker, Willow Primack 외

Recent large language model (LLM) defenses have greatly improved models' ability to refuse harmful queries, even when adversarially attacked. However, LLM defenses are primarily evaluated against automated adversarial at…

Language ModelingLanguage ModellingLarge Language ModelMachine Unlearning+1

JailbreakOPT: Tool-Assisted Iterative Jailbreak Prompt Optimization

2026-06-09 · Ge Shi, Jun Yin, Donglin Xie, Fangyi Liu 외 arxiv

Jailbreak attacks expose persistent safety weaknesses in large language models (LLMs), but existing stateless single-turn methods face a trade-off: hand-crafted prompts are expressive but static, while iterative prompt o…

Multi-turn Jailbreaking Attack in Multi-Modal Large Language Models

2026-01-08 · Badhan Chandra Das, Md Tasnim Jawad, Joaquin Molto, M. Hadi Amini 외 arxiv

In recent years, the security vulnerabilities of Multi-modal Large Language Models (MLLMs) have become a serious concern in the Generative Artificial Intelligence (GenAI) research. These highly intelligent models, capabl…