On the Sample Complexity of Imitation Learning for Smoothed Model Predictive Control
Recent work in imitation learning has shown that having an expert controller that is both suitably smooth and stable enables stronger guarantees on the performance of the learned controller. However, constructing such smoothed expert controllers for arbitrary systems remains challenging, especially in the presence of input and state constraints. As our primary contribution, we show how such a smoothed expert can be designed for a general class of systems using a log-barrier-based relaxation of a standard Model Predictive Control (MPC) optimization problem. At the crux of this theoretical guarantee on smoothness is a new lower bound we prove on the optimality gap of the analytic center associated with a convex Lipschitz function, which we hope could be of independent interest. We validate our theoretical findings via experiments, demonstrating the merits of our smoothing approach over randomized smoothing.
Code (0)
등록된 구현이 없습니다.
Tasks
Imitation LearningLearning TheoryModel Predictive ControlSimilar Papers 제목 키워드 기반
Improved Sample Complexity of Imitation Learning for Barrier Model Predictive Control
Recent work in imitation learning has shown that having an expert controller that is both suitably smooth and stable enables stronger guarantees on the performance of the learned controller. However, constructing such sm…
Imitation LearningModel Predictive ControlIncreasing Information for Model Predictive Control with Semi-Markov Decision Processes
Recent works in Learning-Based Model Predictive Control of dynamical systems show impressive sample complexity performances using criteria from Information Theory to accelerate the learning procedure. However, the sequen…
Model Predictive ControlModel Predictive Control via On-Policy Imitation Learning
In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for …
Imitation LearningmodelModel Predictive ControlReinforcement Learning (RL)Smoothed Score Queries and the Complexity of Sampling
We study the query complexity of sampling from high-dimensional Gaussian distributions using gradient information. In the standard oracle model, exact gradients expose only matrix-vector products with the precision matri…
Model Predictive Adversarial Imitation Learning for Planning from Observation
Human demonstration data is often ambiguous and incomplete, motivating imitation learning approaches that also exhibit reliable planning behavior. A common paradigm to perform planning-from-demonstration involves learnin…
Reinforcement Learning