Deep Reinforcement learning for real autonomous mobile robot navigation in indoor environments
Deep Reinforcement Learning has been successfully applied in various computer games [8]. However, it is still rarely used in real-world applications, especially for the navigation and continuous control of real mobile robots [13]. Previous approaches lack safety and robustness and/or need a structured environment. In this paper we present our proof of concept for autonomous self-learning robot navigation in an unknown environment for a real robot without a map or planner. The input for the robot is only the fused data from a 2D laser scanner and a RGB-D camera as well as the orientation to the goal. The map of the environment is unknown. The output actions of an Asynchronous Advantage Actor-Critic network (GA3C) are the linear and angular velocities for the robot. The navigator/controller network is pretrained in a high-speed, parallel, and self-implemented simulation environment to speed up the learning process and then deployed to the real robot. To avoid overfitting, we train relatively small networks, and we add random Gaussian noise to the input laser data. The sensor data fusion with the RGB-D camera allows the robot to navigate in real environments with real 3D obstacle avoidance and without the need to fit the environment to the sensory capabilities of the robot. To further increase the robustness, we train on environments of varying difficulties and run 32 training instances simultaneously. Video: supplementary File / YouTube, Code: GitHub
Code (3)
Tasks
continuous-controlContinuous ControlDeep Reinforcement LearningNavigatereinforcement-learningReinforcement Learning (RL)Robot NavigationSelf-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation
We study how robots can autonomously learn skills that require a combination of navigation and grasping. While reinforcement learning in principle provides for automated robotic skill learning, in practice reinforcement …
Continual LearningNavigatereinforcement-learningReinforcement Learning+1Deep Reinforcement Learning with Enhanced PPO for Safe Mobile Robot Navigation
Collision-free motion is essential for mobile robots. Most approaches to collision-free and efficient navigation with wheeled robots require parameter tuning by experts to obtain good navigation behavior. This study inve…
Autonomous NavigationDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1Benchmarking Reinforcement Learning Techniques for Autonomous Navigation
Deep reinforcement learning (RL) has brought many successes for autonomous robot navigation. However, there still exists important limitations that prevent real-world use of RL-based navigation systems. For example, most…
Autonomous NavigationBenchmarkingDeep Reinforcement Learningreinforcement-learning+3Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation
Social navigation is the capability of an autonomous agent, such as a robot, to navigate in a 'socially compliant' manner in the presence of other intelligent agents such as humans. With the emergence of autonomously nav…
Imitation LearningNavigateRobot NavigationSocial NavigationArena-Rosnav: Towards Deployment of Deep-Reinforcement-Learning-Based Obstacle Avoidance into Conventional Autonomous Navigation Systems
Recently, mobile robots have become important tools in various industries, especially in logistics. Deep reinforcement learning emerged as an alternative planning method to replace overly conservative approaches and prom…
Autonomous NavigationDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1