paper-with-me

Papers

SmartSnap: Proactive Evidence Seeking for Self-Verifying Agents

2025-12-26 · Shaofei Cai, Yulei Qin, Haojia Lin, Zihan Xu, Gang Li, Yuchen Shi, Zongyi Li, Yong Mao, Siqi Cai, Xiaoyu Tan, Yitao Liang, Ke Li, Xing Sun arxiv

Agentic reinforcement learning (RL) holds great promise for the development of autonomous agents under complex GUI tasks, but its scalability remains severely hampered by the verification of task completion. Existing task verification is treated as a passive, post-hoc process: a verifier (i.e., rule-based scoring script, reward or critic model, and LLM-as-a-Judge) analyzes the agent's entire interaction trajectory to determine if the agent succeeds. Such processing of verbose context that contains irrelevant, noisy history poses challenges to the verification protocols and therefore leads to prohibitive cost and low reliability. To overcome this bottleneck, we propose SmartSnap, a paradigm shift from this passive, post-hoc verification to proactive, in-situ self-verification by the agent itself. We introduce the Self-Verifying Agent, a new type of agent designed with dual missions: to not only complete a task but also to prove its accomplishment with curated snapshot evidences. Guided by our proposed 3C Principles (Completeness, Conciseness, and Creativity), the agent leverages its accessibility to the online environment to perform self-verification on a minimal, decisive set of snapshots. Such evidences are provided as the sole materials for a general LLM-as-a-Judge verifier to determine their validity and relevance. Experiments on mobile tasks across model families and scales demonstrate that our SmartSnap paradigm allows training LLM-driven agents in a scalable manner, bringing performance gains up to 26.08% and 16.66% respectively to 8B and 30B models. The synergizing between solution finding and evidence seeking facilitates the cultivation of efficient, self-verifying agents with competitive performance against DeepSeek V3.1 and Qwen3-235B-A22B. Code is available at: https://github.com/TencentYoutuResearch/SmartSnap

📄 PDF Abstract BibTeX arXiv:2512.22322

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis

2025-12-29 · Shengyi Hua, Jianfeng Wu, Tianle Shen, Kangzhe Hu 외 arxiv

Recent pathological foundation models have substantially advanced visual representation learning and multimodal interaction. However, most models still rely on a static inference paradigm in which whole-slide images are …

Representation LearningReinforcement Learning

ProCIS: A Benchmark for Proactive Retrieval in Conversations

2024-05-10 · Chris Samarinas, Hamed Zamani

The field of conversational information seeking, which is rapidly gaining interest in both academia and industry, is changing how we interact with search engines through natural language interactions. Existing datasets a…

RetrievalText Retrieval

Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiency

2026-08-23 · Zhihong Cao, Chen Huang arxiv

In the context of information seeking, conversational agents are undergoing an evolution from reactive tools to proactive, personalized assistants. A critical aspect of this evolution is the ability to tailor strategic i…

Redefining Proactivity for Information Seeking Dialogue

2024-10-20 · Jing Yang Lee, Seokhwan Kim, Kartik Mehta, Jiun-Yu Kao 외

Information-Seeking Dialogue (ISD) agents aim to provide accurate responses to user queries. While proficient in directly addressing user queries, these agents, as well as LLMs in general, predominantly exhibit reactive …

HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checking

2023-09-15 · Juraj Vladika, Phillip Schneider, Florian Matthes

In the digital age, seeking health advice on the Internet has become a common practice. At the same time, determining the trustworthiness of online medical content is increasingly challenging. Fact-checking has emerged a…

Claim VerificationExplanation GenerationFact CheckingRetrieval