Embodied Visual Navigation with Automatic Curriculum Learning in Real Environments
We present NavACL, a method of automatic curriculum learning tailored to the navigation task. NavACL is simple to train and efficiently selects relevant tasks using geometric features. In our experiments, deep reinforcement learning agents trained using NavACL significantly outperform state-of-the-art agents trained with uniform sampling -- the current standard. Furthermore, our agents can navigate through unknown cluttered indoor environments to semantically-specified targets using only RGB images. Obstacle-avoiding policies and frozen feature networks support transfer to unseen real-world environments, without any modification or retraining requirements. We evaluate our policies in simulation, and in the real world on a ground robot and a quadrotor drone. Videos of real-world results are available in the supplementary material.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningNavigatereinforcement-learningReinforcement Learning (RL)Visual NavigationSimilar Papers 제목 키워드 기반
Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation
In reality, it is often more efficient to ask for help than to search the entire space to find an object with an unknown location. We present a learning framework that enables an agent to actively ask for help in such em…
Visual NavigationRobustness of Utilizing Feedback in Embodied Visual Navigation
This paper presents a framework for training an agent to actively request help in object-goal navigation tasks, with feedback indicating the location of the target object in its field of view. To make the agent more robu…
ObjectVisual NavigationImproving Vision-and-Language Navigation with Image-Text Pairs from the Web
Following a navigation instruction such as 'Walk down the stairs and stop at the brown sofa' requires embodied AI agents to ground scene elements referenced via language (e.g. 'stairs') to visual content in the environme…
Vision and Language NavigationDeep Learning for Embodied Vision Navigation: A Survey
"Embodied visual navigation" problem requires an agent to navigate in a 3D environment mainly rely on its first-person observation. This problem has attracted rising attention in recent years due to its wide application …
Autonomous DrivingDeep LearningNavigateSurvey+1Curriculum Learning for Vision-and-Language Navigation
Vision-and-Language Navigation (VLN) is a task where an agent navigates in an embodied indoor environment under human instructions. Previous works ignore the distribution of sample difficulty and we argue that this poten…
Vision and Language Navigation