Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation

2021-07-28 · Charles Sun, Jędrzej Orbik, Coline Devin, Brian Yang, Abhishek Gupta, Glen Berseth, Sergey Levine

We study how robots can autonomously learn skills that require a combination of navigation and grasping. While reinforcement learning in principle provides for automated robotic skill learning, in practice reinforcement learning in the real world is challenging and often requires extensive instrumentation and supervision. Our aim is to devise a robotic reinforcement learning system for learning navigation and manipulation together, in an autonomous way without human intervention, enabling continual learning under realistic assumptions. Our proposed system, ReLMM, can learn continuously on a real-world platform without any environment instrumentation, without human intervention, and without access to privileged information, such as maps, objects positions, or a global view of the environment. Our method employs a modularized policy with components for manipulation and navigation, where manipulation policy uncertainty drives exploration for the navigation controller, and the manipulation module provides rewards for navigation. We evaluate our method on a room cleanup task, where the robot must navigate to and pick up items scattered on the floor. After a grasp curriculum training phase, ReLMM can learn navigation and grasping together fully automatically, in around 40 hours of autonomous real-world training.

📄 PDF Abstract BibTeX arXiv:2107.13545

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningNavigatereinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Exploring applications of deep reinforcement learning for real-world autonomous driving systems

2019-01-06 · Victor Talpaert, Ibrahim Sobh, B Ravi Kiran, Patrick Mannion 외

Deep Reinforcement Learning (DRL) has become increasingly powerful in recent years, with notable achievements such as Deepmind's AlphaGo. It has been successfully deployed in commercial vehicles like Mobileye's path plan…

Autonomous Driving Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Towards Autonomous Reinforcement Learning for Real-World Robotic Manipulation with Large Language Models

2025-03-06 · Niccolò Turcato, Matteo Iovino, Aris Synodinos, Alberto Dalla Libera 외

Recent advancements in Large Language Models (LLMs) and Visual Language Models (VLMs) have significantly impacted robotics, enabling high-level semantic motion planning applications. Reinforcement Learning (RL), a comple…

Motion Planning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Versatile and Efficient Reinforcement Learning Framework for Autonomous Driving

2021-10-22 · Guan Wang, Haoyi Niu, Desheng Zhu, Jianming Hu 외

Heated debates continue over the best autonomous driving framework. The classic modular pipeline is widely adopted in the industry owing to its great interpretability and stability, whereas the fully end-to-end paradigm …

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Autonomous Driving with Deep Reinforcement Learning in CARLA Simulation

2023-06-20 · Jumman Hossain

Nowadays, autonomous vehicles are gaining traction due to their numerous potential applications in resolving a variety of other real-world challenges. However, developing autonomous vehicles need huge amount of training …

Autonomous Driving Autonomous Vehicles Deep Reinforcement Learning Q-Learning+4

Unleashing the Potential of Diffusion Models for End-to-End Autonomous Driving

2026-02-26 · Yinan Zheng, Tianyi Tan, Bin Huang, Enguang Liu 외 arxiv

Diffusion models have become a popular choice for decision-making tasks in robotics, and more recently, are also being considered for solving autonomous driving tasks. However, their applications and evaluations in auton…

Reinforcement Learning Autonomous Driving