paper-with-me

Papers

Embodied Visual Navigation with Automatic Curriculum Learning in Real Environments

2020-09-11 · Steven D. Morad, Roberto Mecca, Rudra P. K. Poudel, Stephan Liwicki, Roberto Cipolla

We present NavACL, a method of automatic curriculum learning tailored to the navigation task. NavACL is simple to train and efficiently selects relevant tasks using geometric features. In our experiments, deep reinforcement learning agents trained using NavACL significantly outperform state-of-the-art agents trained with uniform sampling -- the current standard. Furthermore, our agents can navigate through unknown cluttered indoor environments to semantically-specified targets using only RGB images. Obstacle-avoiding policies and frozen feature networks support transfer to unseen real-world environments, without any modification or retraining requirements. We evaluate our policies in simulation, and in the real world on a ground robot and a quadrotor drone. Videos of real-world results are available in the supplementary material.

📄 PDF Abstract BibTeX arXiv:2009.05429

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningNavigatereinforcement-learningReinforcement Learning (RL)Visual Navigation

Similar Papers 제목 키워드 기반

Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation

2022-06-20 · Jenny Zhang, Samson Yu, Jiafei Duan, Cheston Tan

In reality, it is often more efficient to ask for help than to search the entire space to find an object with an unknown location. We present a learning framework that enables an agent to actively ask for help in such em…

Visual Navigation

Robustness of Utilizing Feedback in Embodied Visual Navigation

2023-03-06 · Jenny Zhang, Samson Yu, Jiafei Duan, Cheston Tan

This paper presents a framework for training an agent to actively request help in object-goal navigation tasks, with feedback indicating the location of the target object in its field of view. To make the agent more robu…

ObjectVisual Navigation

Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

2020-04-30 · ECCV 2020 8 · Arjun Majumdar, Ayush Shrivastava, Stefan Lee, Peter Anderson 외

Following a navigation instruction such as 'Walk down the stairs and stop at the brown sofa' requires embodied AI agents to ground scene elements referenced via language (e.g. 'stairs') to visual content in the environme…

Vision and Language Navigation

Deep Learning for Embodied Vision Navigation: A Survey

2021-07-07 · Fengda Zhu, Yi Zhu, Vincent CS Lee, Xiaodan Liang 외

"Embodied visual navigation" problem requires an agent to navigate in a 3D environment mainly rely on its first-person observation. This problem has attracted rising attention in recent years due to its wide application …

Autonomous DrivingDeep LearningNavigateSurvey+1

Curriculum Learning for Vision-and-Language Navigation

2021-11-14 · NeurIPS 2021 12 · Jiwen Zhang, Zhongyu Wei, Jianqing Fan, Jiajie Peng

Vision-and-Language Navigation (VLN) is a task where an agent navigates in an embodied indoor environment under human instructions. Previous works ignore the distribution of sample difficulty and we argue that this poten…

Vision and Language Navigation