paper-with-me

홈 › Papers

Ask-before-Plan: Proactive Language Agents for Real-World Planning

2024-06-18 · Xuan Zhang, Yang Deng, Zifeng Ren, See-Kiong Ng, Tat-Seng Chua

The evolution of large language models (LLMs) has enhanced the planning capabilities of language agents in diverse real-world scenarios. Despite these advancements, the potential of LLM-powered agents to comprehend ambiguous user instructions for reasoning and decision-making is still under exploration. In this work, we introduce a new task, Proactive Agent Planning, which requires language agents to predict clarification needs based on user-agent conversation and agent-environment interaction, invoke external tools to collect valid information, and generate a plan to fulfill the user's demands. To study this practical problem, we establish a new benchmark dataset, Ask-before-Plan. To tackle the deficiency of LLMs in proactive planning, we propose a novel multi-agent framework, Clarification-Execution-Planning (\texttt{CEP}), which consists of three agents specialized in clarification, execution, and planning. We introduce the trajectory tuning scheme for the clarification agent and static execution agent, as well as the memory recollection mechanism for the dynamic execution agent. Extensive evaluations and comprehensive analyses conducted on the Ask-before-Plan dataset validate the effectiveness of our proposed framework.

📄 PDF Abstract BibTeX arXiv:2406.12639

Code (1)

magicgh/ask-before-plan 공식 구현

Tasks

Decision Makingvalid

Similar Papers 제목 키워드 기반

Perceive Before Reasoning: A Pre-Reasoning Perception Framework for Efficient and Reliable Proactive Mobile Agents

2026-06-02 · Zhijie Ding, Weinan Hong, Zicheng Zhu, Lei Li 외 arxiv

Multimodal large language models (MLLMs) have substantially advanced mobile agents, yet proactive mobile assistance remains challenging because agents must decide when to intervene before determining how to assist. Exist…

VISTA: A Controllable Platform for Generating and Auditing Egocentric Assistance Scenarios

2026-05-11 · Yu-Hsiang Liu, Yu-Chien Tang, An-Zi Yen arxiv

Evaluating whether AI agents can proactively assist humans in daily activities, ranging from routine household tasks to urgent safety-critical situations, requires diverse visual data. However, collecting such scenarios …

Towards Human-centered Proactive Conversational Agents

2024-04-19 · Yang Deng, Lizi Liao, Zhonghua Zheng, Grace Hui Yang 외

Recent research on proactive conversational agents (PCAs) mainly focuses on improving the system's capabilities in anticipating and planning action sequences to accomplish tasks and achieve goals before users articulate …

Information RetrievalRetrieval

$π$-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows

2026-05-14 · Haoran Zhang, Luxin Xu, Zhilin Wang, Runquan Gui 외 arxiv

The rise of personal assistant agents, e.g., OpenClaw, highlights the growing potential of large language models to support users across everyday life and work. A core challenge in these settings is proactive assistance,…

ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedback

2026-01-15 · Yutao Mou, Zhangchi Xue, Lijun Li, Peiyang Liu 외 arxiv

While LLM-based agents can interact with environments via invoking external tools, their expanded capabilities also amplify security risks. Monitoring step-level tool invocation behaviors in real time and proactively int…

Reinforcement Learning