paper-with-me

Papers

AlignTree: Efficient Defense Against LLM Jailbreak Attacks

2025-11-15 · Gil Goren, Shahar Katz, Lior Wolf arxiv

Large Language Models (LLMs) are vulnerable to adversarial attacks that bypass safety guidelines and generate harmful content. Mitigating these vulnerabilities requires defense mechanisms that are both robust and computationally efficient. However, existing approaches either incur high computational costs or rely on lightweight defenses that can be easily circumvented, rendering them impractical for real-world LLM-based systems. In this work, we introduce the AlignTree defense, which enhances model alignment while maintaining minimal computational overhead. AlignTree monitors LLM activations during generation and detects misaligned behavior using an efficient random forest classifier. This classifier operates on two signals: (i) the refusal direction -- a linear representation that activates on misaligned prompts, and (ii) an SVM-based signal that captures non-linear features associated with harmful content. Unlike previous methods, AlignTree does not require additional prompts or auxiliary guard models. Through extensive experiments, we demonstrate the efficiency and robustness of AlignTree across multiple LLMs and benchmarks.

📄 PDF Abstract BibTeX arXiv:2511.12217

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks

2024-03-02 · Yifan Zeng, Yiran Wu, Xiao Zhang, Huazheng Wang 외

Despite extensive pre-training in moral alignment to prevent generating harmful information, large language models (LLMs) remain vulnerable to jailbreak attacks. In this paper, we propose AutoDefense, a multi-agent defen…

Instruction FollowingLLM real-life tasksMulti-agent Integration

No Free Lunch for Defending Against Prefilling Attack by In-Context Learning

2024-12-13 · Zhiyu Xue, Guangliang Liu, Bocheng Chen, Kristen Marie Johnson 외

The security of Large Language Models (LLMs) has become an important research topic since the emergence of ChatGPT. Though there have been various effective methods to defend against jailbreak attacks, prefilling attacks…

In-Context LearningSafety AlignmentSentence

Test-Time Immunization: A Universal Defense Framework Against Jailbreaks for (Multimodal) Large Language Models

2025-05-28 · Yongcan Yu, Yanbo Wang, Ran He, Jian Liang

While (multimodal) large language models (LLMs) have attracted widespread attention due to their exceptional capabilities, they remain vulnerable to jailbreak attacks. Various defense methods are proposed to defend again…

DETAM: Defending LLMs Against Jailbreak Attacks via Targeted Attention Modification

2025-04-18 · Yu Li, Han Jiang, Zhihua Wei

With the widespread adoption of Large Language Models (LLMs), jailbreak attacks have become an increasingly pressing safety concern. While safety-aligned LLMs can effectively defend against normal harmful queries, they r…

BlueSuffix: Reinforced Blue Teaming for Vision-Language Models Against Jailbreak Attacks

2024-10-28 · Yunhan Zhao, Xiang Zheng, Lin Luo, Yige Li 외

Despite their superb multimodal capabilities, Vision-Language Models (VLMs) have been shown to be vulnerable to jailbreak attacks, which are inference-time attacks that induce the model to output harmful responses with t…

2k