paper-with-me

홈 › Papers

VIGIL: Defending LLM Agents Against Tool Stream Injection via Verify-Before-Commit

2026-01-09 · Junda Lin, Zhaomeng Zhou, Zhi Zheng, Shuochen Liu, Tong Xu, Yong Chen, Enhong Chen arxiv

LLM agents operating in open environments face escalating risks from indirect prompt injection, particularly within the tool stream where manipulated metadata and runtime feedback hijack execution flow. Existing defenses encounter a critical dilemma as advanced models prioritize injected rules due to strict alignment while static protection mechanisms sever the feedback loop required for adaptive reasoning. To reconcile this conflict, we propose \textbf{VIGIL}, a framework that shifts the paradigm from restrictive isolation to a verify-before-commit protocol. By facilitating speculative hypothesis generation and enforcing safety through intent-grounded verification, \textbf{VIGIL} preserves reasoning flexibility while ensuring robust control. We further introduce \textbf{SIREN}, a benchmark comprising 959 tool stream injection cases designed to simulate pervasive threats characterized by dynamic dependencies. Extensive experiments demonstrate that \textbf{VIGIL} outperforms state-of-the-art dynamic defenses by reducing the attack success rate by over 22\% while more than doubling the utility under attack compared to static baselines, thereby achieving an optimal balance between security and utility.

📄 PDF Abstract BibTeX arXiv:2601.05755

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AgentVigil: Generic Black-Box Red-teaming for Indirect Prompt Injection against LLM Agents

2025-05-09 · Zhun Wang, Vincent Siu, Zhe Ye, Tianneng Shi 외

The strong planning and reasoning capabilities of Large Language Models (LLMs) have fostered the development of agent-based systems capable of leveraging external tools and interacting with increasingly complex environme…

NavigateRed Teaming

VIGIL: A Reflective Runtime for Self-Healing Agents

2025-12-08 · Christopher Cruz arxiv

Agentic LLM frameworks promise autonomous behavior via task decomposition, tool use, and iterative planning, but most deployed systems remain brittle. They lack runtime introspection, cannot diagnose their own failure mo…

PVLens: Enhancing Pharmacovigilance Through Automated Label Extraction

2025-03-26 · Jeffery L Painter, Gregory E Powell, Andrew Bate

Reliable drug safety reference databases are essential for pharmacovigilance, yet existing resources like SIDER are outdated and static. We introduce PVLens, an automated system that extracts labeled safety information f…

Pharmacovigilance

VIGIL: An Extensible System for Real-Time Detection and Mitigation of Cognitive Bias Triggers

2026-03-12 · Bo Kang, Sander Noels, Tijl De Bie arxiv

The rise of generative AI is posing increasing risks to online information integrity and civic discourse. Most concretely, such risks can materialise in the form of mis- and disinformation. As a mitigation, media-literac…

Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Agents

2026-02-13 · Xu Li, Simon Yu, Minzhou Pan, Yiyou Sun 외 arxiv

LLM-based agents are becoming increasingly capable, yet their safety lags behind. This creates a gap between what agents can do and should do. This gap widens as agents engage in multi-turn interactions and employ divers…