Learning to Visually Navigate in Photorealistic Environments Without any Supervision
Learning to navigate in a realistic setting where an agent must rely solely on visual inputs is a challenging task, in part because the lack of position information makes it difficult to provide supervision during training. In this paper, we introduce a novel approach for learning to navigate from image inputs without external supervision or reward. Our approach consists of three stages: learning a good representation of first-person views, then learning to explore using memory, and finally learning to navigate by setting its own goals. The model is trained with intrinsic rewards only so that it can be applied to any environment with image observations. We show the benefits of our approach by training an agent to navigate challenging photo-realistic environments from the Gibson dataset with RGB inputs only.
Code (0)
등록된 구현이 없습니다.
Tasks
NavigatePositionSimilar Papers 제목 키워드 기반
Navigating to Objects in Unseen Environments by Distance Prediction
Object Goal Navigation (ObjectNav) task is to navigate an agent to an object category in unseen environments without a pre-built map. In this paper, we solve this task by predicting the distance to the target using seman…
NavigateObjectPredictionNavigation Agents for the Visually Impaired: A Sidewalk Simulator and Experiments
Millions of blind and visually-impaired (BVI) people navigate urban environments every day, using smartphones for high-level path-planning and white canes or guide dogs for local information. However, many BVI people sti…
NavigateReinforcement LearningReinforcement Learning (RL)Visual Navigation Among Humans with Optimal Control as a Supervisor
Real world visual navigation requires robots to operate in unfamiliar, human-occupied dynamic environments. Navigation around humans is especially difficult because it requires anticipating their future motion, which can…
NavigateRobot NavigationSocial NavigationVisual NavigationDrishtikon: An advanced navigational aid system for visually impaired people
Today, many of the aid systems deployed for visually impaired people are mostly made for a single purpose. Be it navigation, object detection, or distance perceiving. Also, most of the deployed aid systems use indoor nav…
NavigateObjectobject-detectionObject DetectionSLAM for Visually Impaired People: a Survey
In recent decades, several assistive technologies have been developed to improve the ability of blind and visually impaired (BVI) individuals to navigate independently and safely. At the same time, simultaneous localizat…
NavigateSimultaneous Localization and MappingSurveySystematic Literature Review