paper-with-me

홈 › Papers

EVOMAL: Self-Poisoning in Self-Evolving Coding Agents

2026-08-26 · Xiaodong Wu, Yu Shi, Qi Li, Zhimin Zhao, Xiangman Li, Bram Adams, Ahmed E. Hassan, Jianbing Ni arxiv

Self-evolving LLM coding agents write their own tools by imitating retrieved skills from shared skill libraries. We identify a vulnerability in this loop: during authoring, a retrieved malicious skill can become the template for a new skill that preserves the payload. We call this self-poisoning: the agent authors, stores, and runs the resulting malicious skill. We exploit it through EvoMal, an attack that amplifies self-poisoning by wrapping an interchangeable payload in a banner, a set of benign-looking structural elements that induces an imitating agent to reproduce the enclosed code. The attacker plants malicious skills in the library without invoking them. The agent then authors and executes new skills carrying the harmful code. Each authored copy can re-enter the library and be imitated again, forming a self-propagating worm that persists after the planted skills are removed. We define the agent self-poisoning rate (ASPR) as the fraction of tasks that add a newly authored malicious skill to the library. Across six models on 153 tool-relevant SWE-bench Verified tasks, ASPR ranges from 20.3% to 41.8%, and the poisoned libraries hold 4.9 to 9.0 times as many malicious skills as were planted. The vulnerability also appears without a banner: DeepSeek-V4-Pro reaches 11.1% ASPR with the payload alone. Tailoring the planted skill descriptions to one task family raises ASPR to 86.7%. After the planted skills are removed, Qwen3 retains a round-5 ASPR of 68% because agent-authored copies remain. These copies evade existing defenses, which focus on attacker-submitted names, code, and signatures. We propose counter-prompt, a defense that discourages banner-style copying and reduces EvoMal's ASPR to at most 6.7% with no significant task-completion loss.

📄 PDF Abstract BibTeX arXiv:2608.25776

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systems

2026-08-06 · Jialuo Chen, Lingqi Jiang, Xinhao Deng, Xiaohu Du 외 arxiv

Self-evolving skill (SES) systems distill agent trajectories into persistent skills, allowing untrusted experience to become trusted instruction. We introduce PoisonedEvolution, a trajectory-poisoning attack on this prom…

Self-Evolving Coding Agents

2026-08-04 · Hao Zhou, Haichuan Hu, Ye Shang, Quanjun Zhang hf

Large language models are increasingly embedded in software engineering workflows as coding agents that can inspect repositories, invoke tools, execute tests, debug failures, and generate patches. Yet most existing agent…

Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharing

2026-02-04 · Zhaotian Weng, Antonis Antoniades, Deepak Nathani, Zhen Zhang 외 arxiv

Open-ended self-improving agents can autonomously modify their own structural designs to advance their capabilities and overcome the limits of pre-defined architectures, thus reducing reliance on human intervention. We i…

ANCHOR: An External LLM-Driven Supervisory Module Facilitating Healthy Evolution in Self-Evolving Systems

2026-06-04 · Dianxing Shi, Bowen Wang, Junqi He, Junhao Chen 외 arxiv

Self-evolving agents improve through continual self-play and self-generated learning signals, but their internally generated tasks and verifier signals provide limited coverage of phase-level errors, allowing capability …

Mathematical Reasoning

Membrane: A Self-Evolving Contrastive Safety Memory for LLM Agent Defense

2026-06-04 · Minseok Choi, Seungbin Yang, Dongjin Kim, Subin Kim 외 arxiv

Despite advances in safety alignment, large language models remain vulnerable to continuously evolving jailbreaks. Existing fine-tuned safety classifiers cannot adapt to these evolving attacks, while adaptive memory-base…