MAMBPO: Sample-efficient multi-robot reinforcement learning using learned world models

2021-03-05 · Daniël Willemsen, Mario Coppola, Guido C. H. E. de Croon

Multi-robot systems can benefit from reinforcement learning (RL) algorithms that learn behaviours in a small number of trials, a property known as sample efficiency. This research thus investigates the use of learned world models to improve sample efficiency. We present a novel multi-agent model-based RL algorithm: Multi-Agent Model-Based Policy Optimization (MAMBPO), utilizing the Centralized Learning for Decentralized Execution (CLDE) framework. CLDE algorithms allow a group of agents to act in a fully decentralized manner after training. This is a desirable property for many systems comprising of multiple robots. MAMBPO uses a learned world model to improve sample efficiency compared to model-free Multi-Agent Soft Actor-Critic (MASAC). We demonstrate this on two simulated multi-robot tasks, where MAMBPO achieves a similar performance to MASAC, but requires far fewer samples to do so. Through this, we take an important step towards making real-life learning for multi-robot systems possible.

📄 PDF Abstract BibTeX arXiv:2103.03662

Code (1)

danielwillemsen/mambpo 공식 구현 pytorch

Tasks

reinforcement-learning Reinforcement Learning (RL)

Offline Learning of Counterfactual Predictions for Real-World Robotic Reinforcement Learning

2020-11-11 · Jun Jin, Daniel Graves, Cameron Haigh, Jun Luo 외

We consider real-world reinforcement learning (RL) of robotic manipulation tasks that involve both visuomotor skills and contact-rich skills. We aim to train a policy that maps multimodal sensory observations (vision and…

counterfactual reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Smart Magnetic Microrobots Learn to Swim with Deep Reinforcement Learning

2022-01-14 · Michael R. Behrens, Warren C. Ruder

Swimming microrobots are increasingly developed with complex materials and dynamic shapes and are expected to operate in complex environments in which the system dynamics are difficult to model and positional control of …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Don't Start From Scratch: Leveraging Prior Data to Automate Robotic Reinforcement Learning

2022-07-11 · Homer Walke, Jonathan Yang, Albert Yu, Aviral Kumar 외

Reinforcement learning (RL) algorithms hold the promise of enabling autonomous skill acquisition for robotic systems. However, in practice, real-world robotic RL typically requires time consuming data collection and freq…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Lifelong Robotic Reinforcement Learning by Retaining Experiences

2021-09-19 · Annie Xie, Chelsea Finn

Multi-task learning ideally allows robots to acquire a diverse repertoire of useful skills. However, many multi-task reinforcement learning efforts assume the robot can collect data from all tasks at all times. In realit…

Multi-Task Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Continual Reinforcement Learning deployed in Real-life using Policy Distillation and Sim2Real Transfer

2019-06-11 · René Traoré, Hugo Caselles-Dupré, Timothée Lesort, Te Sun 외

We focus on the problem of teaching a robot to solve tasks presented sequentially, i.e., in a continual learning scenario. The robot should be able to solve all tasks it has encountered, without forgetting past tasks. We…

Continual Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1