paper-with-me

홈 › Papers

E2CL: Exploration-based Error Correction Learning for Embodied Agents

2024-09-05 · Hanlin Wang, Chak Tou Leong, Jian Wang, Wenjie Li

Language models are exhibiting increasing capability in knowledge utilization and reasoning. However, when applied as agents in embodied environments, they often suffer from misalignment between their intrinsic knowledge and environmental knowledge, leading to infeasible actions. Traditional environment alignment methods, such as supervised learning on expert trajectories and reinforcement learning, encounter limitations in covering environmental knowledge and achieving efficient convergence, respectively. Inspired by human learning, we propose Exploration-based Error Correction Learning (E2CL), a novel framework that leverages exploration-induced errors and environmental feedback to enhance environment alignment for embodied agents. E2CL incorporates teacher-guided and teacher-free explorations to gather environmental feedback and correct erroneous actions. The agent learns to provide feedback and self-correct, thereby enhancing its adaptability to target environments. Extensive experiments in the VirtualHome environment demonstrate that E2CL-trained agents outperform those trained by baseline methods and exhibit superior self-correction capabilities.

📄 PDF Abstract BibTeX arXiv:2409.03256

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hypothesis Graph Refinement: Hypothesis-Driven Exploration with Cascade Error Correction for Embodied Navigation

2026-04-05 · Peixin Chen, Guoxi Zhang, Jianwei Ma, Qing Li arxiv

Embodied agents must explore partially observed environments while maintaining reliable long-horizon memory. Existing graph-based navigation systems improve scalability, but they often treat unexplored regions as semanti…

Question Answering

Software Engineering Agents for Embodied Controller Generation : A Study in Minigrid Environments

2025-10-24 · Timothé Boulet, Xavier Hinaut, Clément Moulin-Frier arxiv

Software Engineering Agents (SWE-Agents) have proven effective for traditional software engineering tasks with accessible codebases, but their performance for embodied tasks requiring well-designed information discovery …

Beyond the Destination: A Novel Benchmark for Exploration-Aware Embodied Question Answering

2025-03-14 · Kaixuan Jiang, Yang Liu, Weixing Chen, Jingzhou Luo 외

Embodied Question Answering (EQA) is a challenging task in embodied intelligence that requires agents to dynamically explore 3D environments, actively gather visual information, and perform multi-step reasoning to answer…

Embodied Question AnsweringQuestion Answering

Boosting Zero-Shot VLN via Abstract Obstacle Map-Based Waypoint Prediction with TopoGraph-and-VisitInfo-Aware Prompting

2025-09-24 · Boqi Li, Siyuan Li, Weiyi Wang, Anran Li 외 arxiv

With the rapid progress of foundation models and robotics, vision-language navigation (VLN) has emerged as a key task for embodied agents with broad practical applications. We address VLN in continuous environments, a pa…

Vision-Language Navigation

ReEXplore: Improving MLLMs for Embodied Exploration with Contextualized Retrospective Experience Replay

2025-11-24 · Gengyuan Zhang, Mingcong Ding, Jingpei Wu, Ruotong Liao 외 arxiv

Embodied exploration is a target-driven process that requires embodied agents to possess fine-grained perception and knowledge-enhanced decision making. While recent attempts leverage MLLMs for exploration due to their s…

Reinforcement LearningDecision Making