paper-with-me

홈 › Papers

Hidden in Memory: Sleeper Memory Poisoning in LLM Agents

2026-05-14 · Sidharth Pulipaka, Stanislau Hlebik, Leonidas Raghav, Sahar Abdelnabi, Vyas Raina, Ivaxi Sheth, Mario Fritz arxiv

Large language models are increasingly augmented with persistent memory, allowing assistants to store user-specific information across sessions for personalization and continuity. This statefulness introduces a new security risk: adversarial content can corrupt what an assistant remembers and thereby influence future interactions. We propose and study sleeper memory poisoning, a delayed attack in which an adversary manipulates external context, such as a document, webpage, or repository, to cause the assistant to store a fabricated memory about the user. Unlike conventional prompt injection, the attack can remain dormant and re-emerge across multiple later conversations. We evaluate the full attack pipeline: whether poisoned memories are written, later retrieved, and ultimately used to steer the following conversations. Across stateful LLM assistants, poisoned memories were added up to 99.8% on GPT-5.5 and 95% on Kimi-K2.6. Crucially, among successful retrievals, poisoned memories cause attacker-intended agentic actions in 60-89% of evaluations across models. These results show that persistent memory can act as a long-term attack surface across multiple future conversations.

📄 PDF Abstract BibTeX arXiv:2605.15338

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from Scratch

2021-06-16 · Hossein Souri, Liam Fowl, Rama Chellappa, Micah Goldblum 외

As the curation of data for machine learning becomes increasingly automated, dataset tampering is a mounting threat. Backdoor attackers tamper with training data to embed a vulnerability in models that are trained on tha…

Backdoor Attack

SuperLocalMemory: Privacy-Preserving Multi-Agent Memory with Bayesian Trust Defense Against Memory Poisoning

2026-02-17 · Varun Pratap Bhardwaj arxiv

We present SuperLocalMemory, a local-first memory system for multi-agent AI that defends against OWASP ASI06 memory poisoning through architectural isolation and Bayesian trust scoring, while personalizing retrieval thro…

Graph Clustering

The Trigger in the Haystack: Extracting and Reconstructing LLM Backdoor Triggers

2026-02-03 · Blake Bullwinkel, Giorgio Severi, Keegan Hines, Amanda Minnich 외 arxiv

Detecting whether a model has been poisoned is a longstanding problem in AI security. In this work, we present a practical scanner for identifying sleeper agent-style backdoors in causal language models. Our approach rel…

From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents

2026-06-03 · Pritam Dash, Tongyu Ge, Aditi Jain, Tanmay Shah 외 arxiv

Memory is a core component of AI agents, enabling them to accumulate knowledge across interactions and improve performance. However, persistent memory introduces the risk of memory poisoning, where a single adversarial m…

Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoning

2026-04-18 · Jiachen Qian arxiv

The evolution from static ranking models to Agentic Recommender Systems (Agentic RecSys) empowers AI agents to maintain long-term user profiles and autonomously plan service tasks. While this paradigm shift enhances pers…