paper-with-me

홈 › Papers

Learning-Augmented Model-Based Planning for Visual Exploration

2022-11-15 · Yimeng Li, Arnab Debnath, Gregory Stein, Jana Kosecka

We consider the problem of time-limited robotic exploration in previously unseen environments where exploration is limited by a predefined amount of time. We propose a novel exploration approach using learning-augmented model-based planning. We generate a set of subgoals associated with frontiers on the current map and derive a Bellman Equation for exploration with these subgoals. Visual sensing and advances in semantic mapping of indoor scenes are exploited for training a deep convolutional neural network to estimate properties associated with each frontier: the expected unobserved area beyond the frontier and the expected timesteps (discretized actions) required to explore it. The proposed model-based planner is guaranteed to explore the whole scene if time permits. We thoroughly evaluate our approach on a large-scale pseudo-realistic indoor dataset (Matterport3D) with the Habitat simulator. We compare our approach with classical and more recent RL-based exploration methods. Our approach surpasses the greedy strategies by 2.1% and the RL-based exploration methods by 8.4% in terms of coverage.

📄 PDF Abstract BibTeX arXiv:2211.07898

Code (0)

등록된 구현이 없습니다.

Tasks

model

Similar Papers 제목 키워드 기반

G-DRAGON: Geospatial Reasoning and Dynamic Planning for Retrieval-Augmented Outdoor Navigation

2026-05-25 · Dongzhihan Wang, Yi Du, Jianan Sun, Yuan Xue 외 arxiv

Autonomous ground robots operating in large-scale outdoor environments require both robust long-range navigation and fine-grained ''last-mile'' exploration. Current advances in visual-language navigation (VLN) work well …

Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation

2021-11-11 · I-Chun Arthur Liu, Shagun Uppal, Gaurav S. Sukhatme, Joseph J. Lim 외

Learning complex manipulation tasks in realistic, obstructed environments is a challenging problem due to hard exploration in the presence of obstacles and high-dimensional visual observations. Prior work tackles the exp…

Imitation LearningMotion Planningreinforcement-learningReinforcement Learning+2

Exploratory Retrieval-Augmented Planning For Continual Embodied Instruction Following

2025-09-10 · Minjong Yoo, Jinwoo Jang, Wei-jin Park, Honguk Woo arxiv

This study presents an Exploratory Retrieval-Augmented Planning (ExRAP) framework, designed to tackle continual instruction following tasks of embodied agents in dynamic, non-stationary environments. The framework enhanc…

Instruction Following

Planning-Augmented Sampling with Early Guidance for High-Reward Discovery

2025-10-01 · Rui Zhu, Yudong Zhang, Xuan Yu, Chen Zhang 외 arxiv

Generative Flow Networks (GFlowNets) enable structured generation with inherent diversity, but existing sampling strategies often rely on weak guided exploration, slowing early discovery of high-reward candidates. In tas…

Explicit Planning for Efficient Exploration in Reinforcement Learning

2019-12-01 · NeurIPS 2019 12 · Liangpeng Zhang, Ke Tang, Xin Yao

Efficient exploration is crucial to achieving good performance in reinforcement learning. Existing systematic exploration strategies (R-MAX, MBIE, UCRL, etc.), despite being promising theoretically, are essentially greed…

Efficient Explorationreinforcement-learningReinforcement LearningReinforcement Learning (RL)