paper-with-me

홈 › Papers

Poison Once, Exploit Forever: Environment-Injected Memory Poisoning Attacks on Web Agents

2026-04-03 · Wei Zou, Mingwen Dong, Miguel Romero Calvo, Shuaichen Chang, Jiang Guo, Dongkyu Lee, Xing Niu, Xiaofei Ma, Yanjun Qi, Jiarong Jiang arxiv

Memory makes LLM-based web agents personalized, powerful, yet exploitable. By storing past interactions to personalize future tasks, agents inadvertently create a persistent attack surface that spans websites and sessions. While existing security research on memory assumes attackers can directly inject into memory storage or exploit shared memory across users, we present a more realistic threat model: contamination through environmental observation alone. We introduce Environment-injected Trajectory-based Agent Memory Poisoning (eTAMP), the first attack to achieve cross-session, cross-site compromise without requiring direct memory access. A single contaminated observation (e.g., viewing a manipulated product page) silently poisons an agent's memory and activates during future tasks on different websites, bypassing permission-based defenses. Our experiments on (Visual)WebArena reveal two key findings. First, eTAMP achieves substantial attack success rates: up to 32.5% on GPT-5-mini, 23.4% on GPT-5.2, and 19.5% on GPT-OSS-120B. Second, we discover Frustration Exploitation: agents under environmental stress become dramatically more susceptible, with ASR increasing up to 8 times when agents struggle with dropped clicks or garbled text. Notably, more capable models are not more secure. GPT-5.2 shows substantial vulnerability despite superior task performance. With the rise of AI browsers like OpenClaw, ChatGPT Atlas, and Perplexity Comet, our findings underscore the urgent need for defenses against environment-injected memory poisoning.

📄 PDF Abstract BibTeX arXiv:2604.02623

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Poison Once, Refuse Forever: Weaponizing Alignment for Injecting Bias in LLMs

2025-08-28 · Md Abdullah Al Mamun, Ihsen Alouani, Nael Abu-Ghazaleh arxiv

Large Language Models (LLMs) are aligned to meet ethical standards and safety requirements by training them to refuse answering harmful or unsafe prompts. In this paper, we demonstrate how adversaries can exploit LLMs' a…

Towards One Shot Search Space Poisoning in Neural Architecture Search

2021-11-13 · Nayan Saxena, Robert Wu, Rohan Jain

We evaluate the robustness of a Neural Architecture Search (NAS) algorithm known as Efficient NAS (ENAS) against data agnostic poisoning attacks on the original search space with carefully designed ineffective operations…

Neural Architecture Search

Backdoor Vulnerabilities in Normally Trained Deep Learning Models

2022-11-29 · Guanhong Tao, Zhenting Wang, Siyuan Cheng, Shiqing Ma 외

We conduct a systematic study of backdoor vulnerabilities in normally trained Deep Learning models. They are as dangerous as backdoors injected by data poisoning because both can be equally exploited. We leverage 20 diff…

Data PoisoningDeep Learning

Hijacking Agent Memory: Stealthy Trojan Attacks Through Conversational Interaction

2026-05-28 · Hongtao Wang, Se Yang, Yu Chen, Puzhuo Liu arxiv

Large language model (LLM) agents increasingly leverage long term memory to support persistent and autonomous task execution. However, this capability also introduces a new attack surface: memory poisoning, where adversa…

Enhancing Prompt Injection Attacks to LLMs via Poisoning Alignment

2024-10-18 · Zedian Shao, Hongbin Liu, Jaden Mu, Neil Zhenqiang Gong

In a prompt injection attack, an attacker injects a prompt into the original one, aiming to make an LLM follow the injected prompt to perform an attacker-chosen task. Existing attacks primarily focus on how to blend the …