paper-with-me

홈 › Papers

X-Planner: Event-Structured Task Planning for Embodied Intelligence

2026-09-21 · Howard Lu, Shalfun Li, Porter Pan, Cris, Lumen, Cyril, Eric Hu, Lily Li, Maeve Zhang, Robert Wang, KZ Zheng, Viggo Chen, Tim Ding, Regsis Cheng, YJ Xiao, Kian, Hai Lin, Alan Song, Elise Ma, Gody Li, Victor Yao, Yohann Tang, Ingrid Yu, Jason He, James Wang, Ryan Yu, Ping Yang, Chris Pan, Vincent Chen, Roy Gan, Hao Wang, Qian Wang hf

Task planning bridges high-level instructions and executable behavior in long-horizon manipulation, yet modern Vision-Language-Action (VLA) systems often leave this intermediate structure implicit. Existing chain-of-thought (CoT) planners also tend to rely on coarse task-level annotations or serialize long reasoning traces token by token. We present X-Planner, a planning front-end that addresses both the supervision and representation of embodied reasoning. Our planning data combine Ego, UMI, and teleoperation under a hierarchy granularity with source-dependent annotation depth. Takeover-time annotations and human-designed failures supervise ongoing error recognition. On the model side, a shared VLM backbone exposes two event-structured plan forms: a discrete interface that emits interpretable event states and a latent interface that relays continuous CoT states across staggered Transformer depths through Staircase Decoding. A frozen latent-to-text reconstruction objective provides a semantic anchor for the latent representation. Offline two-step planning evaluation places X-Planner second among four evaluated models on both BERTScore-F1 and a judge-based Overall score. In real-robot experiments, respectively, outperforming the evaluated baselines. These results characterize planning-text quality and downstream execution.

📄 PDF Abstract BibTeX arXiv:2609.25187

Code (2)

X-Square-Robot/Xplanner ★ 134
🤗 x-square-robot/X-Planner-9B-0916

Similar Papers 제목 키워드 기반

SDA-PLANNER: State-Dependency Aware Adaptive Planner for Embodied Task Planning

2025-09-30 · Zichao Shen, Chen Gao, Jiaqi Yuan, Tianchen Zhu 외 arxiv

Embodied task planning requires agents to produce executable actions in a close-loop manner within the environment. With progressively improving capabilities of LLMs in task decomposition, planning, and generalization, c…

From Failures to Supervision: DynamicEnvPlan for Robust Long-Horizon Embodied Planning

2026-08-01 · Hao Yuan, Yuxin Wang, Lei Ji, Zhiwei Yu arxiv

Physical-world interaction is inherently dynamic, as environments can evolve during execution, requiring agents to adapt their plans under non-stationary conditions. We study this challenge through long-horizon embodied …

Target-Driven Structured Transformer Planner for Vision-Language Navigation

2022-07-19 · Yusheng Zhao, Jinyu Chen, Chen Gao, Wenguan Wang 외

Vision-language navigation is the task of directing an embodied agent to navigate in 3D scenes with natural language instructions. For the agent, inferring the long-term navigation target from visual-linguistic clues is …

NavigateVision-Language Navigation

Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Following

2024-04-21 · Suyeon Shin, Sujin jeon, Junghyun Kim, Gi-Cheon Kang 외

Embodied Instruction Following (EIF) is the task of executing natural language instructions by navigating and interacting with objects in interactive environments. A key challenge in EIF is compositional task planning, t…

In-Context LearningInstruction FollowingLanguage ModelingLanguage Modelling+2

MagicSim: A Unified Infrastructure for Executable Embodied Interaction

2026-06-16 · Haoran Lu, Songling Liu, Yue Chen, Guo Ye 외 arxiv

Robot learning and embodied agents now require simulation to serve as a shared execution substrate linking control, skills, and planning, not only as a renderer, controller testbed, or fixed task environment. Existing pi…