paper-with-me

홈 › Papers

Activation-Guided Local Editing for Jailbreaking Attacks

2025-08-01 · Jiecong Wang, Haoran Li, Hao Peng, Ziqian Zeng, Zihao Wang, Haohua Du, Zhengtao Yu arxiv

Jailbreaking is an essential adversarial technique for red-teaming these models to uncover and patch security flaws. However, existing jailbreak methods face significant drawbacks. Token-level jailbreak attacks often produce incoherent or unreadable inputs and exhibit poor transferability, while prompt-level attacks lack scalability and rely heavily on manual effort and human ingenuity. We propose a concise and effective two-stage framework that combines the advantages of these approaches. The first stage performs a scenario-based generation of context and rephrases the original malicious query to obscure its harmful intent. The second stage then utilizes information from the model's hidden states to guide fine-grained edits, effectively steering the model's internal representation of the input from a malicious toward a benign one. Extensive experiments demonstrate that this method achieves state-of-the-art Attack Success Rate, with gains of up to 37.74% over the strongest baseline, and exhibits excellent transferability to black-box models. Our analysis further demonstrates that AGILE maintains substantial effectiveness against prominent defense mechanisms, highlighting the limitations of current safeguards and providing valuable insights for future defense development. Our code is available at https://github.com/SELGroup/AGILE.

📄 PDF Abstract BibTeX arXiv:2508.00555

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing

2025-05-28 · Yifan Lu, Jing Li, Yigeng Zhou, Yihui Zhang 외

Large language models (LLMs) exhibit impressive language capabilities but remain vulnerable to malicious prompts and jailbreaking attacks. Existing knowledge editing methods for LLM detoxification face two major challeng…

Instruction Followingknowledge editing

Mitigating Backdoor Attacks using Activation-Guided Model Editing

2024-07-10 · Felix Hsieh, Huy H. Nguyen, AprilPyone MaungMaung, Dmitrii Usynin 외

Backdoor attacks compromise the integrity and reliability of machine learning models by embedding a hidden trigger during the training process, which can later be activated to cause unintended misbehavior. We propose a n…

Machine UnlearningModel Editing

Shared Latent Structures Enable Unified Backdoor Detection and Mitigation in LLMs

2026-06-06 · Omar Mahmoud, Aly M. Kassem, Thommen George Karimpanal, Buddhika Laknath Semage 외 arxiv

Backdoor attacks in large language models (LLMs) are often treated as isolated trigger-response failures, motivating defenses tailored to specific triggers or behaviors. We show this view is incomplete. Across diverse ba…

Fuzz-Testing Meets LLM-Based Agents: An Automated and Efficient Framework for Jailbreaking Text-To-Image Generation Models

2024-08-01 · Yingkai Dong, Xiangtao Meng, Ning Yu, Zheng Li 외

Text-to-image (T2I) generative models have revolutionized content creation by transforming textual descriptions into high-quality images. However, these models are vulnerable to jailbreaking attacks, where carefully craf…

Image GenerationIn-Context LearningLanguage ModellingLarge Language Model+2

DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing

2025-02-17 · Yi Wang, Fenghua Weng, Sibei Yang, Zhan Qin 외

Large Language Models (LLMs) are widely applied in decision making, but their deployment is threatened by jailbreak attacks, where adversarial users manipulate model behavior to bypass safety measures. Existing defense m…

Decision MakingLanguage ModelingLanguage ModellingLarge Language Model+3