Model-Based Policy Search for Automatic Tuning of Multivariate PID Controllers

2017-03-08 · Andreas Doerr, Duy Nguyen-Tuong, Alonso Marco, Stefan Schaal, Sebastian Trimpe

PID control architectures are widely used in industrial applications. Despite their low number of open parameters, tuning multiple, coupled PID controllers can become tedious in practice. In this paper, we extend PILCO, a model-based policy search framework, to automatically tune multivariate PID controllers purely based on data observed on an otherwise unknown system. The system's state is extended appropriately to frame the PID policy as a static state feedback policy. This renders PID tuning possible as the solution of a finite horizon optimal control problem without further a priori knowledge. The framework is applied to the task of balancing an inverted pendulum on a seven degree-of-freedom robotic arm, thereby demonstrating its capabilities of fast and data-efficient policy learning, even on complex real world problems.

📄 PDF Abstract BibTeX arXiv:1703.02899

Code (0)

등록된 구현이 없습니다.

Sample-Efficient Reinforcement Learning of Koopman eNMPC

2025-03-24 · Daniel Mayfrank, Mehmet Velioglu, Alexander Mitsos, Manuel Dahmen

Reinforcement learning (RL) can be used to tune data-driven (economic) nonlinear model predictive controllers ((e)NMPCs) for optimal performance in a specific control task by optimizing the dynamic model or parameters in…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning Robust Controllers Via Probabilistic Model-Based Policy Search

2021-10-26 · Valentin Charvet, Bjørn Sand Jensen, Roderick Murray-Smith

Model-based Reinforcement Learning estimates the true environment through a world model in order to approximate the optimal policy. This family of algorithms usually benefits from better sample efficiency than their mode…

Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Automatic LQR Tuning Based on Gaussian Process Global Optimization

2016-05-06 · Alonso Marco, Philipp Hennig, Jeannette Bohg, Stefan Schaal 외

This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved accordin…

Bayesian Optimization global-optimization

Learning Smooth Humanoid Locomotion through Lipschitz-Constrained Policies

2024-10-15 · Zixuan Chen, Xialin He, Yen-Jen Wang, Qiayuan Liao 외

Reinforcement learning combined with sim-to-real transfer offers a general framework for developing locomotion controllers for legged robots. To facilitate successful deployment in the real world, smoothing techniques, s…

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

2022-03-08 · Xiangyu Zhang, Abinet Tesfaye Eseye, Bernard Knueven, Weijia Liu 외

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) b…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1