paper-with-me

Papers

Plan Verification for LLM-Based Embodied Task Completion Agents

2025-09-02 · Ananth Hariharan, Vardhan Dongre, Dilek Hakkani-Tür, Gokhan Tur arxiv

Large language model (LLM) based task plans and corresponding human demonstrations for embodied AI may be noisy, with unnecessary actions, redundant navigation, and logical errors that reduce policy quality. We propose an iterative verification framework in which a Judge LLM critiques action sequences and a Planner LLM applies the revisions, yielding progressively cleaner and more spatially coherent trajectories. Unlike rule-based approaches, our method relies on natural language prompting, enabling broad generalization across error types including irrelevant actions, contradictions, and missing steps. On a set of manually annotated actions from the TEACh embodied AI dataset, our framework achieves up to 90% recall and 100% precision across four state-of-the-art LLMs (GPT o4-mini, DeepSeek-R1, Gemini 2.5, LLaMA 4 Scout). The refinement loop converges quickly, with 96.5% of sequences requiring at most three iterations, while improving both temporal efficiency and spatial action organization. Crucially, the method preserves human error-recovery patterns rather than collapsing them, supporting future work on robust corrective behavior. By establishing plan verification as a reliable LLM capability for spatial planning and action refinement, we provide a scalable path to higher-quality training data for imitation learning in embodied AI.

📄 PDF Abstract BibTeX arXiv:2509.02761

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning to Solve Voxel Building Embodied Tasks from Pixels and Natural Language Instructions

2022-11-01 · Alexey Skrynnik, Zoya Volovikova, Marc-Alexandre Côté, Anton Voronov 외

The adoption of pre-trained language models to generate action plans for embodied agents is a promising research strategy. However, execution of instructions in real or simulated environments requires verification of the…

Language ModelingLanguage ModellingMinecraftreinforcement-learning+1

SocialGrid: A Benchmark for Planning and Social Reasoning in Embodied Multi-Agent Systems

2026-04-17 · Hikaru Shindo, Hanzhao Lin, Lukas Helff, Patrick Schramowski 외 arxiv

As Large Language Models (LLMs) transition from text processors to autonomous agents, evaluating their social reasoning in embodied multi-agent settings becomes critical. We introduce SocialGrid, an embodied multi-agent …

Multimodal Contextualized Plan Prediction for Embodied Task Completion

2023-05-10 · Mert İnan, Aishwarya Padmakumar, Spandana Gella, Patrick Lange 외

Task planning is an important component of traditional robotics systems enabling robots to compose fine grained skills to perform more complex tasks. Recent work building systems for translating natural language to execu…

PredictionTask Planning

A Framework for Benchmarking and Aligning Task-Planning Safety in LLM-Based Embodied Agents

2025-04-20 · YuTing Huang, Leilei Ding, Zhipeng Tang, Tianfu Wang 외

Large Language Models (LLMs) exhibit substantial promise in enhancing task-planning capabilities within embodied agents due to their advanced reasoning and comprehension. However, the systemic safety of these agents rema…

BenchmarkingTask Planning

Collaborative Tree Search for Enhancing Embodied Multi-Agent Collaboration

2025-01-01 · CVPR 2025 1 · Lizheng Zu, Lin Lin, Song Fu, Na Zhao 외

Embodied agents based on large language models (LLMs) face significant challenges in collaborative tasks, requiring effective communication and reasonable division of labor to ensure efficient and correct task comple…