Vision-based Navigation Using Deep Reinforcement Learning

2019-08-08 · Jonáš Kulhánek, Erik Derner, Tim de Bruin, Robert Babuška

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning architecture capable of navigating an agent, e.g. a mobile robot, to a target given by an image. To achieve this, we have extended the batched A2C algorithm with auxiliary tasks designed to improve visual navigation performance. We propose three additional auxiliary tasks: predicting the segmentation of the observation image and of the target image and predicting the depth-map. These tasks enable the use of supervised learning to pre-train a large part of the network and to reduce the number of training steps substantially. The training performance has been further improved by increasing the environment complexity gradually over time. An efficient neural network structure is proposed, which is capable of learning for multiple targets in multiple environments. Our method navigates in continuous state spaces and on the AI2-THOR environment simulator outperforms state-of-the-art goal-oriented visual navigation methods from the literature.

📄 PDF Abstract BibTeX arXiv:1908.03627

Code (1)

jkulhanek/a2cat-vn-pytorch 공식 구현 pytorch

Tasks

Deep Reinforcement LearningEfficient Neural Networkreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Visual Navigation

Methods 이 논문이 사용한 방법론

A2C A2C, or Advantage Actor Critic, is a synchronous version of the A3C policy gradient method. As an alternative to the asynchronous…

Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation

2018-03-21 · ECCV 2018 9 · Xin Wang, Wenhan Xiong, Hongmin Wang, William Yang Wang

Existing research studies on vision and language grounding for robot navigation focus on improving model-free deep reinforcement learning (DRL) models in synthetic environments. However, model-free DRL models do not cons…

Deep Reinforcement Learning model Model-based Reinforcement Learning reinforcement-learning+5

VALAN: Vision and Language Agent Navigation

2019-12-06 · Larry Lansing, Vihan Jain, Harsh Mehta, Haoshuo Huang 외

VALAN is a lightweight and scalable software framework for deep reinforcement learning based on the SEED RL architecture. The framework facilitates the development and evaluation of embodied agents for solving grounded l…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Scaling, Benchmarking, and Reasoning of Vision-Language Agents for Mobile GUI Navigation

2026-05-26 · Heng Qu, Yike Liu, Renren Jin, Wenzong Zhang 외 arxiv

Vision-Language Models (VLMs) have shown rapid progress in mobile GUI navigation. This paper presents a systematic study of data scaling, benchmarking, and reasoning for VLM-based agents in this domain. To facilitate rig…

Reinforcement Learning

NavigationNet: A Large-scale Interactive Indoor Navigation Dataset

2018-08-25 · He Huang, Yujing Shen, Jiankai Sun, Cewu Lu

Indoor navigation aims at performing navigation within buildings. In scenes like home and factory, most intelligent mobile devices require an functionality of routing to guide itself precisely through indoor scenes to co…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

SeeNav-Agent: Enhancing Vision-Language Navigation with Visual Prompt and Step-Level Policy Optimization

2025-12-02 · Zhengcheng Wang, Zichuan Lin, Yijun Yang, Haobo Fu 외 arxiv

Existing Vision-Language Navigation (VLN) agents based on Large Vision-Language Models (LVLMs) often suffer from perception errors, reasoning errors, and planning errors, which significantly hinder their navigation perfo…

Vision-Language Navigation Reinforcement Learning