paper-with-me

Papers

CausalArmor: Efficient Indirect Prompt Injection Guardrails via Causal Attribution

2026-02-08 · Minbeom Kim, Mihir Parmar, Phillip Wallis, Lesly Miculicich, Kyomin Jung, Krishnamurthy Dj Dvijotham, Long T. Le, Tomas Pfister arxiv

AI agents equipped with tool-calling capabilities are susceptible to Indirect Prompt Injection (IPI) attacks. In this attack scenario, malicious commands hidden within untrusted content trick the agent into performing unauthorized actions. Existing defenses can reduce attack success but often suffer from the over-defense dilemma: they deploy expensive, always-on sanitization regardless of actual threat, thereby degrading utility and latency even in benign scenarios. We revisit IPI through a causal ablation perspective: a successful injection manifests as a dominance shift where the user request no longer provides decisive support for the agent's privileged action, while a particular untrusted segment, such as a retrieved document or tool output, provides disproportionate attributable influence. Based on this signature, we propose CausalArmor, a selective defense framework that (i) computes lightweight, leave-one-out ablation-based attributions at privileged decision points, and (ii) triggers targeted sanitization only when an untrusted segment dominates the user intent. Additionally, CausalArmor employs retroactive Chain-of-Thought masking to prevent the agent from acting on ``poisoned'' reasoning traces. We present a theoretical analysis showing that sanitization based on attribution margins conditionally yields an exponentially small upper bound on the probability of selecting malicious actions. Experiments on AgentDojo and DoomArena demonstrate that CausalArmor matches the security of aggressive defenses while improving explainability and preserving utility and latency of AI agents.

📄 PDF Abstract BibTeX arXiv:2602.07918

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LlamaFirewall: An open source guardrail system for building secure AI agents

2025-05-06 · Sahana Chennabasappa, Cyrus Nikolaidis, Daniel Song, David Molnar 외

Large language models (LLMs) have evolved from simple chatbots into autonomous agents capable of performing complex tasks such as editing production code, orchestrating workflows, and taking higher-stakes actions based o…

Chatbot

When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift

2026-02-15 · Max Fomin arxiv

Detecting prompt injection and jailbreak attacks is critical for deploying LLM-based agents safely. As agents increasingly process untrusted data from emails, documents, tool outputs, and external APIs, robust attack det…

Maatphor: Automated Variant Analysis for Prompt Injection Attacks

2023-12-12 · Ahmed Salem, Andrew Paverd, Boris Köpf

Prompt injection has emerged as a serious security threat to large language models (LLMs). At present, the current best-practice for defending against newly-discovered prompt injection techniques is to add additional gua…

A Comparative Evaluation of AI Agent Security Guardrails

2026-04-27 · Qi Li, Jiu Li, Pingtao Wei, Jianjun Xu 외 arxiv

This report presents a comparative evaluation of DKnownAI Guard in AI agent security scenarios, benchmarked against three competing products: AWS Bedrock Guardrails, Azure Content Safety, and Lakera Guard. Using human an…

VATS: Exploiting Implicit Authority in Error-Path Injection via Systematic Mutation

2026-06-06 · Harshil Patel, Kunal Pai arxiv

As the Model Context Protocol (MCP) standardizes tool-calling for autonomous agents, it introduces a critical, unexamined attack surface: the error-handling loop. We hypothesize that tool error messages possess implicit …