paper-with-me

Papers

Towards Unifying Quantitative Security Benchmarking for Multi Agent Systems

2025-07-23 · Gauri Sharma, Vidhi Kulkarni, Miles King, Ken Huang arxiv

Evolving AI systems increasingly deploy multi-agent architectures where autonomous agents collaborate, share information, and delegate tasks through developing protocols. This connectivity, while powerful, introduces novel security risks. One such risk is a cascading risk: a breach in one agent can cascade through the system, compromising others by exploiting inter-agent trust. In tandem with OWASP's initiative for an Agentic AI Vulnerability Scoring System we define an attack vector, Agent Cascading Injection, analogous to Agent Impact Chain and Blast Radius, operating across networks of agents. In an ACI attack, a malicious input or tool exploit injected at one agent leads to cascading compromises and amplified downstream effects across agents that trust its outputs. We formalize this attack with an adversarial goal equation and key variables (compromised agent, injected exploit, polluted observations, etc.), capturing how a localized vulnerability can escalate into system-wide failure. We then analyze ACI's properties -- propagation chains, amplification factors, and inter-agent compound effects -- and map these to OWASP's emerging Agentic AI risk categories (e.g. Impact Chain and Orchestration Exploits). Finally, we argue that ACI highlights a critical need for quantitative benchmarking frameworks to evaluate the security of agent-to-agent communication protocols. We outline a methodology for stress-testing multi-agent systems (using architectures such as Google's A2A and Anthropic's MCP) against cascading trust failures, developing upon groundwork for measurable, standardized agent-to-agent security evaluation. Our work provides the necessary apparatus for engineers to benchmark system resilience, make data-driven architectural trade-offs, and develop robust defenses against a new generation of agentic threats.

📄 PDF Abstract BibTeX arXiv:2507.21146

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ConVerse: Benchmarking Contextual Safety in Agent-to-Agent Conversations

2025-11-07 · Amr Gomaa, Ahmed Salem, Sahar Abdelnabi arxiv

As language models evolve into autonomous agents that act and communicate on behalf of users, ensuring safety in multi-agent ecosystems becomes a central challenge. Interactions between personal assistants and external s…

SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Tasks

2025-06-13 · Hwiwon Lee, Ziqi Zhang, Hanxiao Lu, Lingming Zhang

Rigorous security-focused evaluation of large language model (LLM) agents is imperative for establishing trust in their safe deployment throughout the software development lifecycle. However, existing benchmarks largely …

BenchmarkingLarge Language Model

Measuring Security Without Fooling Ourselves: Why Benchmarking Agents Is Hard

2026-05-21 · Sahar Abdelnabi, Chris Hicks, Konrad Rieck, Ahmad-Reza Sadeghi arxiv

The benchmarks used to evaluate AI agents in security-critical roles suffer from crucial weaknesses. Building on recent empirical evidence, we characterize three core challenges that undermine security evaluations: bench…

SkillTester: Benchmarking Utility and Security of Agent Skills

2026-03-28 · Leye Wang, Zixing Wang, Anjie Xu arxiv

This technical report presents SkillTester, a tool for evaluating the utility and security of agent skills. Its evaluation framework combines paired baseline and with-skill execution conditions with a separate security p…

SecBench: A Comprehensive Multi-Dimensional Benchmarking Dataset for LLMs in Cybersecurity

2024-12-30 · Pengfei Jing, Mengyun Tang, Xiaorong Shi, Xing Zheng 외

Evaluating Large Language Models (LLMs) is crucial for understanding their capabilities and limitations across various applications, including natural language processing and code generation. Existing benchmarks like MML…

BenchmarkingCode GenerationHumanEvalLogical Reasoning+2