paper-with-me

홈 › Papers

MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning

2026-05-24 · Xuanye Zhang, Yongsen Zheng, Zhuqin Xu, Kaiyu Zhou, Bowen Shen, Haoran Ou, Tianwei Zhang, Kwok-Yan Lam arxiv

LLM-driven agents are capable of selecting external tools to complete users' tasks. However, attackers could compromise such process, steering agents toward inappropriate/wrong tools and enabling malicious actions. Most existing attacks primarily manipulate the tool metadata, which is easily detectable by auditing and may lose effectiveness as modern agents increasingly adopt memory modules to refine tool selection policies through accumulated experience. This paper proposes MemMorph, the first attack that bias tool selection by poisoning the agent's long-term memory. Rather than explicitly dictating the tool invocation decision, MemMorph injects a small number of crafted records that are disguised as technical facts, incident reports, and operational policies. These poisoned records reshape the agent's contextual perception and decision-making process, leading it to autonomously infer and select the tool preferred by the attacker. Experiments across 3 benchmarks, 10 agent backbones, and 3 memory-module implementations show that MemMorph achieves up to 85.9% attack success rate with only three injected records, outperforming the strongest baseline by up to 25% while retaining potency under 3 representative defenses. Our findings expose long-term memory as a critical and under-explored attack surface in tool-augmented agents, urging the development of memory-level integrity safeguards.

📄 PDF Abstract BibTeX arXiv:2605.26154

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Security-Auditable LLM Agents: A Unified Graph Representation

2026-05-07 · Chaofan Li, Lyuye Zhang, Jintao Zhai, Siyue Feng 외 arxiv

LLM-based agentic systems are rapidly evolving to perform complex autonomous tasks through dynamic tool invocation, stateful memory management, and multi-agent collaboration. However, this semantics-driven execution para…

AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks

2026-02-18 · Tanqiu Jiang, Yuhui Wang, Jiacheng Liang, Ting Wang arxiv

LLM agents are increasingly deployed in long-horizon, complex environments to solve challenging problems, but this expansion exposes them to long-horizon attacks that exploit multi-turn user-agent-environment interaction…

Hijacking Agent Memory: Stealthy Trojan Attacks Through Conversational Interaction

2026-05-28 · Hongtao Wang, Se Yang, Yu Chen, Puzhuo Liu arxiv

Large language model (LLM) agents increasingly leverage long term memory to support persistent and autonomous task execution. However, this capability also introduces a new attack surface: memory poisoning, where adversa…

Agent-Fence: Mapping Security Vulnerabilities Across Deep Research Agents

2026-02-07 · Sai Puppala, Ismail Hossain, Md Jahangir Alam, Yoonpyo Lee 외 arxiv

Large language models are increasingly deployed as *deep agents* that plan, maintain persistent state, and invoke external tools, shifting safety failures from unsafe text to unsafe *trajectories*. We introduce **AgentFe…

From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents

2026-06-03 · Pritam Dash, Tongyu Ge, Aditi Jain, Tanmay Shah 외 arxiv

Memory is a core component of AI agents, enabling them to accumulate knowledge across interactions and improve performance. However, persistent memory introduces the risk of memory poisoning, where a single adversarial m…