paper-with-me

Papers

Learning to Visually Navigate in Photorealistic Environments Without any Supervision

2020-04-10 · Lina Mezghani, Sainbayar Sukhbaatar, Arthur Szlam, Armand Joulin, Piotr Bojanowski

Learning to navigate in a realistic setting where an agent must rely solely on visual inputs is a challenging task, in part because the lack of position information makes it difficult to provide supervision during training. In this paper, we introduce a novel approach for learning to navigate from image inputs without external supervision or reward. Our approach consists of three stages: learning a good representation of first-person views, then learning to explore using memory, and finally learning to navigate by setting its own goals. The model is trained with intrinsic rewards only so that it can be applied to any environment with image observations. We show the benefits of our approach by training an agent to navigate challenging photo-realistic environments from the Gibson dataset with RGB inputs only.

📄 PDF Abstract BibTeX arXiv:2004.04954

Code (0)

등록된 구현이 없습니다.

Tasks

NavigatePosition

Similar Papers 제목 키워드 기반

Navigating to Objects in Unseen Environments by Distance Prediction

2022-02-08 · Minzhao Zhu, Binglei Zhao, Tao Kong

Object Goal Navigation (ObjectNav) task is to navigate an agent to an object category in unseen environments without a pre-built map. In this paper, we solve this task by predicting the distance to the target using seman…

NavigateObjectPrediction

Navigation Agents for the Visually Impaired: A Sidewalk Simulator and Experiments

2019-10-29 · Martin Weiss, Simon Chamorro, Roger Girgis, Margaux Luck 외

Millions of blind and visually-impaired (BVI) people navigate urban environments every day, using smartphones for high-level path-planning and white canes or guide dogs for local information. However, many BVI people sti…

NavigateReinforcement LearningReinforcement Learning (RL)

Visual Navigation Among Humans with Optimal Control as a Supervisor

2020-03-20 · Varun Tolani, Somil Bansal, Aleksandra Faust, Claire Tomlin

Real world visual navigation requires robots to operate in unfamiliar, human-occupied dynamic environments. Navigation around humans is especially difficult because it requires anticipating their future motion, which can…

NavigateRobot NavigationSocial NavigationVisual Navigation

Drishtikon: An advanced navigational aid system for visually impaired people

2019-04-23 · Shashank Kotyan, Nishant Kumar, Pankaj Kumar Sahu, Venkanna Udutalapally

Today, many of the aid systems deployed for visually impaired people are mostly made for a single purpose. Be it navigation, object detection, or distance perceiving. Also, most of the deployed aid systems use indoor nav…

NavigateObjectobject-detectionObject Detection

SLAM for Visually Impaired People: a Survey

2022-12-09 · Marziyeh Bamdad, Davide Scaramuzza, Alireza Darvishy

In recent decades, several assistive technologies have been developed to improve the ability of blind and visually impaired (BVI) individuals to navigate independently and safely. At the same time, simultaneous localizat…

NavigateSimultaneous Localization and MappingSurveySystematic Literature Review