paper-with-me

Papers

Conjunctive Prompt Attacks in Multi-Agent LLM Systems

2026-04-17 · Nokimul Hasan Arif, Qian Lou, Mengxin Zheng arxiv

Most LLM safety work studies single-agent models, but many real applications rely on multiple interacting agents. In these systems, prompt segmentation and inter-agent routing create attack surfaces that single-agent evaluations miss. We study \emph{conjunctive prompt attacks}, where a trigger key in the user query and a hidden adversarial template in one compromised remote agent each appear benign alone but activate harmful behavior when routing brings them together. We consider an attacker who changes neither model weights nor the client agent and instead controls only trigger placement and template insertion. Across star, chain, and DAG topologies, routing-aware optimization substantially increases attack success over non-optimized baselines while keeping false activations low. Existing defenses, including PromptGuard, Llama-Guard variants, and system-level controls such as tool restrictions, do not reliably stop the attack because no single component appears malicious in isolation. These results expose a structural vulnerability in agentic LLM pipelines and motivate defenses that reason over routing and cross-agent composition. Code is available at https://github.com/UCF-ML-Research/ConjunctiveAgents.

📄 PDF Abstract BibTeX arXiv:2604.16543

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systems

2026-08-01 · Neha Nagaraja, Amisha Bagari, Hayretdin Bahsi arxiv

Large language models are increasingly integrated into autonomous robotic systems for task planning and control, but this integration exposes them to prompt injection attacks that can lead to unsafe decisions and physica…

Safety is Non-Compositional: A Formal Framework for Capability-Based AI Systems

2026-03-16 · Cosimo Spera arxiv

This paper contains the first formal proof that safety is non-compositional in the presence of conjunctive capability dependencies: two agents each individually inca- pable of reaching any forbidden capability can, when …

Prompt Injection 2.0: Hybrid AI Threats

2025-07-17 · Jeremy McHugh, Kristina Šekrst, Jon Cefalu

Prompt injection attacks, where malicious input is designed to manipulate AI systems into ignoring their original instructions and following unauthorized commands instead, were first discovered by Preamble, Inc. in May 2…

Investigating Detection and Obfuscation of Prompt Injection Attacks Against Software Reverse Engineering AI Agents

2026-05-29 · Brian Crawford, Patrick McClure arxiv

Agentic software reverse engineering systems are vulnerable to prompt injection attacks placed into the source code of executable binary files. This research demonstrates defensive tactics for detecting the presences of …

CourtGuard: A Local, Multiagent Prompt Injection Classifier

2025-10-20 · Isaac Wu, Michael Maslowski arxiv

As large language models (LLMs) become integrated into various sensitive applications, prompt injection, the use of prompting to induce harmful behaviors from LLMs, poses an ever increasing risk. Prompt injection attacks…