paper-with-me

홈 › Papers

Recon-Act: A Self-Evolving Multi-Agent Browser-Use System via Web Reconnaissance, Tool Generation, and Task Execution

2025-09-25 · Kaiwen He, Zhiwei Wang, Chenyi Zhuang, Jinjie Gu arxiv

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from disordered action sequencing and excessive trial and error during execution. This paper introduces Recon-Act, a self-evolving multi-agent framework grounded in Reconnaissance-Action behavioral paradigm. The system comprises a Reconnaissance Team and an Action Team: the former conducts comparative analysis and tool generation, while the latter handles intent decomposition, tool orchestration, and execution. By contrasting the erroneous trajectories with successful ones, the Reconnaissance Team infers remedies, and abstracts them into a unified notion of generalized tools, either expressed as hints or as rule-based codes, and register to the tool archive in real time. The Action Team reinference the process empowered with these targeting tools, thus establishing a closed-loop training pipeline of data-tools-action-feedback. Following the 6 level implementation roadmap proposed in this work, we have currently reached Level 3 (with limited human-in-the-loop intervention). Leveraging generalized tools obtained through reconnaissance, Recon-Act substantially improves adaptability to unseen websites and solvability on long-horizon tasks, and achieves state-of-the-art performance on the challenging VisualWebArena dataset.

📄 PDF Abstract BibTeX arXiv:2509.21072

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Same-Origin Policy for Agentic Browsers

2026-06-12 · Xilong Wang, Xiaoxing Chen, Patrick Li, Dawn Song 외 arxiv

Agentic browsers integrate autonomous AI agents into web browsers, enabling users to accomplish web tasks through natural-language instructions. The same-origin policy (SOP) is a fundamental browser security mechanism th…

EvolveSearch: An Iterative Self-Evolving Search Agent

2025-05-28 · Dingchu Zhang, Yida Zhao, Jialong Wu, Baixuan Li 외

The rapid advancement of large language models (LLMs) has transformed the landscape of agentic information seeking capabilities through the integration of tools such as search engines and web browsers. However, current m…

Multi-hop Question AnsweringQuestion Answering

WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidance

2025-11-17 · Genglin Liu, Shijie Geng, Sha Li, Hejie Cui 외 arxiv

Multimodal LLM-powered agents have recently demonstrated impressive capabilities in web navigation, enabling agents to complete complex browsing tasks across diverse domains. However, current agents struggle with repetit…

Continual Learning

BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents

2025-11-25 · Kaiyuan Zhang, Mark Tenenholtz, Kyle Polley, Jerry Ma 외 arxiv

The integration of artificial intelligence (AI) agents into web browsers introduces security challenges that go beyond traditional web application threat models. Prior work has identified prompt injection as a new attack…

BraveGuard: From Open-World Threats to Safer Computer-Use Agents

2026-05-31 · Yunhao Feng, Xiaohu Du, Xinhao Deng, Yifan Ding 외 arxiv

Computer-use agents extend language models from text generation to sustained interaction with files, terminals, browsers, and external tools. This shift creates safety risks that are difficult to detect from isolated pro…

Text Generation