Learning to control from expert demonstrations

2022-03-09 · Alimzhan Sultangazin, Luigi Pannocchi, Lucas Fraile, Paulo Tabuada

In this paper, we revisit the problem of learning a stabilizing controller from a finite number of demonstrations by an expert. By first focusing on feedback linearizable systems, we show how to combine expert demonstrations into a stabilizing controller, provided that demonstrations are sufficiently long and there are at least $n+1$ of them, where $n$ is the number of states of the system being controlled. When we have more than $n+1$ demonstrations, we discuss how to optimally choose the best $n+1$ demonstrations to construct the stabilizing controller. We then extend these results to a class of systems that can be embedded into a higher-dimensional system containing a chain of integrators. The feasibility of the proposed algorithm is demonstrated by applying it on a CrazyFlie 2.0 quadrotor.

📄 PDF Abstract BibTeX arXiv:2203.05012

Code (0)

등록된 구현이 없습니다.

Accelerating Self-Imitation Learning from Demonstrations via Policy Constraints and Q-Ensemble

2022-12-07 · Chao Li

Deep reinforcement learning (DRL) provides a new way to generate robot control policy. However, the process of training control policy requires lengthy exploration, resulting in a low sample efficiency of reinforcement l…

continuous-control Continuous Control Deep Reinforcement Learning Imitation Learning+4

Improving Generative Adversarial Imitation Learning with Non-expert Demonstrations

2018-09-27 · Voot Tangkaratt, Masashi Sugiyama

Imitation learning aims to learn an optimal policy from expert demonstrations and its recent combination with deep learning has shown impressive performance. However, collecting a large number of expert demonstrations fo…

continuous-control Continuous Control Deep Learning Imitation Learning

Learn to Exceed: Stereo Inverse Reinforcement Learning with Concurrent Policy Optimization

2020-09-21 · Feng Tao, Yongcan Cao

In this paper, we study the problem of obtaining a control policy that can mimic and then outperform expert demonstrations in Markov decision processes where the reward function is unknown to the learning agent. One main…

reinforcement-learning Reinforcement Learning (RL)

Sample-Efficient Multi-Agent Reinforcement Learning with Demonstrations for Flocking Control

2022-09-17 · Yunbo Qiu, Yuzhu Zhan, Yue Jin, Jian Wang 외

Flocking control is a significant problem in multi-agent systems such as multi-agent unmanned aerial vehicles and multi-agent autonomous underwater vehicles, which enhances the cooperativity and safety of agents. In cont…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

A Bayesian Approach to Policy Recognition and State Representation Learning

2016-05-04 · Adrian Šošić, Abdelhak M. Zoubir, Heinz Koeppl

Learning from demonstration (LfD) is the process of building behavioral models of a task from demonstrations provided by an expert. These models can be used e.g. for system control by generalizing the expert demonstratio…

Representation Learning