MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
Theory-of-Mind (ToM) reasoning enables embodied agents to understand human beliefs, goals, and intentions, but existing benchmarks mainly evaluate this ability through offline question answering or scenario-level action prediction. MindPower advances embodied ToM by introducing robot-centric reasoning from perception to action; however, it does not evaluate whether an agent can continuously interact with a changing environment and intervene only when assistance is needed. Building on MindPower, we introduce the MindHelper Challenge, which extends embodied ToM evaluation to real-time closed-loop precision intervention. An agent must continuously observe the environment, maintain actor-specific beliefs, identify when a human requires assistance, generate executable actions, and remain silent when intervention is unnecessary. We further propose MindClaw, a simple yet effective Claw-style framework that integrates an actor-specific Belief Table, embodied cognitive skills, and a Trigger-based cognitive dispatcher. Experiments show that MindClaw achieves 36.63% precise intervention rate and 14.36\% task accuracy, substantially outperforming direct VLM baselines, whose corresponding results remain below 12.05% and 3.80%.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringSimilar Papers 제목 키워드 기반
Zetta ζ: An Efficient Closed-Loop Embodied Harness for Self-Evolving Physical Intelligence
Embodied agents are increasingly used to close the gap left by end-to-end policy models. Yet the agentic path has not realized closed-loop learning in physical execution: existing harnesses remain largely open-loop, foll…
HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory
LLM agents follow a practical execution loop in digital environments: they reason over structured states, invoke tools, inspect feedback, and revise actions. Extending this loop to physical robots is difficult because ph…
World-in-World: World Models in a Closed-Loop World
Generative world models (WMs) can now simulate worlds with striking visual realism, which naturally raises the question of whether they can endow embodied agents with predictive perception for decision making. Progress o…
Decision MakingCLEA: Closed-Loop Embodied Agent for Enhancing Task Execution in Dynamic Environments
Large Language Models (LLMs) exhibit remarkable capabilities in the hierarchical decomposition of complex tasks through semantic reasoning. However, their application in embodied systems faces challenges in ensuring reli…
Task PlanningVidarc: Embodied Video Diffusion Model for Closed-loop Control
Robotic arm manipulation in data-scarce settings is a highly challenging task due to the complex embodiment dynamics and diverse contexts. Recent video-based approaches have shown great promise in capturing and transferr…