paper-with-me

Papers

WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidance

2025-11-17 · Genglin Liu, Shijie Geng, Sha Li, Hejie Cui, Sarah Zhang, Xin Liu, Tianyi Liu arxiv

Multimodal LLM-powered agents have recently demonstrated impressive capabilities in web navigation, enabling agents to complete complex browsing tasks across diverse domains. However, current agents struggle with repetitive errors and lack the ability to learn from past experiences across sessions, limiting their long-term robustness and sample efficiency. We introduce WebCoach, a model-agnostic self-evolving framework that equips web browsing agents with persistent cross-session memory, enabling improved long-term planning, reflection, and continual learning without retraining. WebCoach consists of three key components: (1) a WebCondenser, which standardizes raw navigation logs into concise summaries; (2) an External Memory Store, which organizes complete trajectories as episodic experiences; and (3) a Coach, which retrieves relevant experiences based on similarity and recency, and decides whether to inject task-specific advice into the agent via runtime hooks. This design empowers web agents to access long-term memory beyond their native context window, improving robustness in complex browsing tasks. Moreover, WebCoach achieves self-evolution by continuously curating episodic memory from new navigation trajectories, enabling agents to improve over time without retraining. Evaluations on the WebVoyager benchmark demonstrate that WebCoach consistently improves the performance of browser-use agents across three different LLM backbones. With a 38B model, it increases task success rates from 47% to 61% while reducing or maintaining the average number of steps. Notably, smaller base models with WebCoach achieve performance comparable to the same web agent using GPT-4o.

📄 PDF Abstract BibTeX arXiv:2511.12997

Code (0)

등록된 구현이 없습니다.

Tasks

Continual Learning

Similar Papers 제목 키워드 기반

Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injections

2026-02-17 · Xianglin Yang, Yufei He, Shuo Ji, Bryan Hooi 외 arxiv

Self-evolving LLM agents update their internal state across sessions, often by writing and reusing long-term memory. This design improves performance on long-horizon tasks but creates a security risk: untrusted external …

RGMem: Renormalization Group-inspired Memory Evolution for Language Agents

2025-10-18 · Ao Tian, Yunfeng Lu, Xinxin Fan, Changhao Wang 외 arxiv

Personalized and continuous interactions are critical for LLM-based conversational agents, yet finite context windows and static parametric memory hinder the modeling of long-term, cross-session user states. Existing app…

Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversations

2026-05-30 · Adril Putra Merin, David Anugraha, Ayu Purwarianti, Genta Indra Winata arxiv

Recent advances in agentic AI have enabled agents to complete complex tasks through tool use, reasoning, and multi-step planning. Yet existing benchmarks evaluate agents within a single session, ignoring past actions, st…

AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?

2026-07-31 · Dong Yan, Jian Liang, Dapeng Hu, Ran He 외 hf

Large language model (LLM) agents can self-evolve by continually improving from their own accumulated experience. However, existing studies predominantly adopt independent evaluation. Consequently, the behavior of self-e…

Evolving Agents in the Dark: Retrospective Harness Optimization via Self-Preference

2026-06-04 · Wenbo Pan, Shujie Liu, Chin-Yew Lin, Jingying Zeng 외 arxiv

AI agents rely on a harness of skills, tools, and workflows to solve complex problems. Continually improving this harness is essential for adapting to new tasks. However, existing optimization methods typically require g…