paper-with-me

Papers

Mitigating Safety Fallback in Editing-based Backdoor Injection on LLMs

2025-06-16 · Houcheng Jiang, Zetong Zhao, Junfeng Fang, Haokai Ma, Ruipeng Wang, Yang Deng, Xiang Wang, Xiangnan He

Large language models (LLMs) have shown strong performance across natural language tasks, but remain vulnerable to backdoor attacks. Recent model editing-based approaches enable efficient backdoor injection by directly modifying parameters to map specific triggers to attacker-desired responses. However, these methods often suffer from safety fallback, where the model initially responds affirmatively but later reverts to refusals due to safety alignment. In this work, we propose DualEdit, a dual-objective model editing framework that jointly promotes affirmative outputs and suppresses refusal responses. To address two key challenges -- balancing the trade-off between affirmative promotion and refusal suppression, and handling the diversity of refusal expressions -- DualEdit introduces two complementary techniques. (1) Dynamic loss weighting calibrates the objective scale based on the pre-edited model to stabilize optimization. (2) Refusal value anchoring compresses the suppression target space by clustering representative refusal value vectors, reducing optimization conflict from overly diverse token sets. Experiments on safety-aligned LLMs show that DualEdit improves attack success by 9.98\% and reduces safety fallback rate by 10.88\% over baselines.

📄 PDF Abstract BibTeX arXiv:2506.13285

Code (1)

zhaozetong/dualedit 공식 구현 pytorch

Tasks

DiversityModel EditingSafety Alignment

Similar Papers 제목 키워드 기반

BadEdit: Backdooring large language models by model editing

2024-03-20 · Yanzhou Li, Tianlin Li, Kangjie Chen, Jian Zhang 외

Mainstream backdoor attack methods typically demand substantial tuning data for poisoning, limiting their practicality and potentially degrading the overall performance when applied to Large Language Models (LLMs). To ad…

Backdoor Attackknowledge editingmodelModel Editing

Injecting Universal Jailbreak Backdoors into LLMs in Minutes

2025-02-09 · Zhuowei Chen, Qiannan Zhang, Shichao Pei

Jailbreak backdoor attacks on LLMs have garnered attention for their effectiveness and stealth. However, existing methods rely on the crafting of poisoned datasets and the time-consuming process of fine-tuning. In this w…

Model Editing

Neural Cleanse: Identifying and Mitigating Backdoor Attacks in Neural Networks

2019-05-19 · IEEE Symposium on Security and Privacy (SP) 2019 5 · Bolun Wang, Yuanshun Yao, Shawn Shan, Huiying Li 외

Lack of transparency in deep neural networks (DNNs) make them susceptible to backdoor attacks, where hidden associations or triggers override normal classification to produce unexpected results. For example, a model with…

Backdoor AttackSelf-Driving Cars

bi-GRPO: Bidirectional Optimization for Jailbreak Backdoor Injection on LLMs

2025-09-24 · Wence Ji, Jiancan Wu, Aiying Li, Shuyi Zhang 외 arxiv

With the rapid advancement of large language models (LLMs), their robustness against adversarial manipulations, particularly jailbreak backdoor attacks, has become critically important. Existing approaches to embedding j…

Reinforcement Learning

Can Editing LLMs Inject Harm?

2024-07-29 · Canyu Chen, Baixiang Huang, Zekun Li, Zhaorun Chen 외

Knowledge editing has been increasingly adopted to correct the false or outdated knowledge in Large Language Models (LLMs). Meanwhile, one critical but under-explored question is: can knowledge editing be used to inject …

FairnessGeneral Knowledgeknowledge editingMisinformation+2