paper-with-me

홈 › Papers

Backdoor Collapse: Eliminating Unknown Threats via Known Backdoor Aggregation in Language Models

2025-10-11 · Liang Lin, Miao Yu, Moayad Aloqaily, Zhenhong Zhou, Kun Wang, Linsey Pang, Prakhar Mehrotra, Qingsong Wen arxiv

Backdoor attacks are a significant threat to large language models (LLMs), often embedded via public checkpoints, yet existing defenses rely on impractical assumptions about trigger settings. To address this challenge, we propose \ourmethod, a defense framework that requires no prior knowledge of trigger settings. \ourmethod is based on the key observation that when deliberately injecting known backdoors into an already-compromised model, both existing unknown and newly injected backdoors aggregate in the representation space. \ourmethod leverages this through a two-stage process: \textbf{first}, aggregating backdoor representations by injecting known triggers, and \textbf{then}, performing recovery fine-tuning to restore benign outputs. Extensive experiments across multiple LLM architectures demonstrate that: (I) \ourmethod reduces the average Attack Success Rate to 4.41\% across multiple benchmarks, outperforming existing baselines by 28.1\%$\sim$69.3\%$\uparrow$. (II) Clean accuracy and utility are preserved within 0.5\% of the original model, ensuring negligible impact on legitimate tasks. (III) The defense generalizes across different types of backdoors, confirming its robustness in practical deployment scenarios.

📄 PDF Abstract BibTeX arXiv:2510.10265

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Magnitude-based Neuron Pruning for Backdoor Defens

2024-05-28 · Nan Li, Haoyu Jiang, Ping Yi

Deep Neural Networks (DNNs) are known to be vulnerable to backdoor attacks, posing concerning threats to their reliable deployment. Recent research reveals that backdoors can be erased from infected DNNs by pruning a spe…

backdoor defense

Dummy Backdoor as a Defense: Removing Unknown Backdoors via Shared Internal Mechanisms for Generative LLMs

2026-06-10 · Kazuki Iwahana, Masaru Matsubayashi, Takuma Koyama, Toshiki Shibahara 외 arxiv

Backdoor attacks pose a serious threat to the safety and reliability of Large Language Models (LLMs), as they cause models to behave normally on clean inputs while producing attacker-specified responses when hidden trigg…

Secure Transfer Learning: Training Clean Models Against Backdoor in (Both) Pre-trained Encoders and Downstream Datasets

2025-04-16 · Yechao Zhang, Yuxuan Zhou, Tianyu Li, Minghui Li 외

Transfer learning from pre-trained encoders has become essential in modern machine learning, enabling efficient model adaptation across diverse tasks. However, this combination of pre-training and downstream adaptation c…

Transfer Learning

Backdoor Vectors: a Task Arithmetic View on Backdoor Attacks and Defenses

2025-10-09 · Stanisław Pawlak, Jan Dubiński, Daniel Marczak, Bartłomiej Twardowski arxiv

Model merging (MM) recently emerged as an effective method for combining large deep learning models. However, it poses significant security risks. Recent research shows that it is highly susceptible to backdoor attacks, …

Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats

2024-09-29 · Kuanrong Liu, Siyuan Liang, Jiawei Liang, Pengwen Dai 외

Multimodal contrastive learning uses various data modalities to create high-quality features, but its reliance on extensive data sources on the Internet makes it vulnerable to backdoor attacks. These attacks insert malic…

Backdoor Attackbackdoor defenseContrastive LearningMachine Unlearning