paper-with-me

홈 › Papers

GuardNet: Graph-Attention Filtering for Jailbreak Defense in Large Language Models

2025-09-27 · Javad Forough, Mohammad Maheri, Hamed Haddadi arxiv

Large Language Models (LLMs) are increasingly susceptible to jailbreak attacks, which are adversarial prompts that bypass alignment constraints and induce unauthorized or harmful behaviors. These vulnerabilities undermine the safety, reliability, and trustworthiness of LLM outputs, posing critical risks in domains such as healthcare, finance, and legal compliance. In this paper, we propose GuardNet, a hierarchical filtering framework that detects and filters jailbreak prompts prior to inference. GuardNet constructs structured graphs that combine sequential links, syntactic dependencies, and attention-derived token relations to capture both linguistic structure and contextual patterns indicative of jailbreak behavior. It then applies graph neural networks at two levels: (i) a prompt-level filter that detects global adversarial prompts, and (ii) a token-level filter that pinpoints fine-grained adversarial spans. Extensive experiments across three datasets and multiple attack settings show that GuardNet substantially outperforms prior defenses. It raises prompt-level F$_1$ scores from 66.4\% to 99.8\% on LLM-Fuzzer, and from 67-79\% to over 94\% on PLeak datasets. At the token level, GuardNet improves F$_1$ from 48-75\% to 74-91\%, with IoU gains up to +28\%. Despite its structural complexity, GuardNet maintains acceptable latency and generalizes well in cross-domain evaluations, making it a practical and robust defense against jailbreak threats in real-world LLM deployments.

📄 PDF Abstract BibTeX arXiv:2509.23037

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

GuardNet: Ensemble Strategies of Shallow Neural Networks for Robust Prompt Injection and Jailbreak Detection

2026-06-04 · Paulo Ricardo Ferreira Neves, Edson Rodrigues da Cruz Filho, Paulo Henrique Eleuterio Falsetti, João Vitor Pavan 외 arxiv

Large Language Models (LLMs) have transformed natural language processing, but they remain vulnerable to Prompt Injection (PI) and Jailbreak (JB) attacks. In addition, benchmark evaluations may be affected by contaminati…

Jailbreaking Large Vision Language Models in Intelligent Transportation Systems

2025-11-17 · Badhan Chandra Das, Md Tasnim Jawad, Md Jueal Mia, M. Hadi Amini 외 arxiv

Large Vision Language Models (LVLMs) demonstrate strong capabilities in multimodal reasoning and many real-world applications, such as visual question answering. However, LVLMs are highly vulnerable to jailbreaking attac…

Visual Question AnsweringMultimodal Reasoning

HSF: Defending against Jailbreak Attacks with Hidden State Filtering

2024-08-31 · Cheng Qian, Hainan Zhang, Lei Sha, Zhiming Zheng

With the growing deployment of LLMs in daily applications like chatbots and content generation, efforts to ensure outputs align with human values and avoid harmful content have intensified. However, increasingly sophisti…

LLM Jailbreak

AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks

2024-03-02 · Yifan Zeng, Yiran Wu, Xiao Zhang, Huazheng Wang 외

Despite extensive pre-training in moral alignment to prevent generating harmful information, large language models (LLMs) remain vulnerable to jailbreak attacks. In this paper, we propose AutoDefense, a multi-agent defen…

Instruction FollowingLLM real-life tasksMulti-agent Integration

AttentionDefense: Leveraging System Prompt Attention for Explainable Defense Against Novel Jailbreaks

2025-04-10 · Charlotte Siska, Anush Sankaran

In the past few years, Language Models (LMs) have shown par-human capabilities in several domains. Despite their practical applications and exceeding user consumption, they are susceptible to jailbreaks when malicious in…