Predictive reinforcement learning based adaptive PID controller

2025-06-10 · Chaoqun Ma, Zhiyong Zhang

Purpose: This study aims to address the challenges of controlling unstable and nonlinear systems by proposing an adaptive PID controller based on predictive reinforcement learning (PRL-PID), where the PRL-PID combines the advantages of both data-driven and model-driven approaches. Design/methodology/approach: A predictive reinforcement learning framework is introduced, incorporating action smooth strategy to suppress overshoot and oscillations, and a hierarchical reward function to support training. Findings: Experimental results show that the PRL-PID controller achieves superior stability and tracking accuracy in nonlinear, unstable, and strongly coupled systems, consistently outperforming existing RL-tuned PID methods while maintaining excellent robustness and adaptability across diverse operating conditions. Originality/Value: By adopting predictive learning, the proposed PRL-PID integrates system model priors into data-driven control, enhancing both the control framework's training efficiency and the controller's stability. As a result, PRL-PID provides a balanced blend of model-based and data-driven approaches, delivering robust, high-performance control.

📄 PDF Abstract BibTeX arXiv:2506.08509

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning

Comparison of Model Predictive and Reinforcement Learning Methods for Fault Tolerant Control

2020-08-10 · Ibrahim Ahmed, Hamed Khorasgani, Gautam Biswas

A desirable property in fault-tolerant controllers is adaptability to system changes as they evolve during systems operations. An adaptive controller does not require optimal control policies to be enumerated for possibl…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotion

2023-07-15 · Vyacheslav Kovalev, Anna Shkromada, Henni Ouerdane, Pavel Osinenko

Stable gait generation is a crucial problem for legged robot locomotion as this impacts other critical performance factors such as, e.g. mobility over an uneven terrain and power consumption. Gait generation stability re…

Model Predictive Control reinforcement-learning Reinforcement Learning (RL)

Adaptive PD Control using Deep Reinforcement Learning for Local-Remote Teleoperation with Stochastic Time Delays

2023-05-26 · Luc McCutcheon, Saber Fallah

Local-remote systems allow robots to execute complex tasks in hazardous environments such as space and nuclear power stations. However, establishing accurate positional mapping between local and remote devices can be dif…

Deep Reinforcement Learning Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning

Self-optimizing adaptive optics control with Reinforcement Learning for high-contrast imaging

2021-08-24 · Rico Landman, Sebastiaan Y. Haffert, Vikram M. Radhakrishnan, Christoph U. Keller

Current and future high-contrast imaging instruments require extreme adaptive optics (XAO) systems to reach contrasts necessary to directly image exoplanets. Telescope vibrations and the temporal error induced by the lat…

reinforcement-learning Reinforcement Learning (RL)

RNN-based linear parameter varying adaptive model predictive control for autonomous driving

2024-10-14 · International Journal of Systems Science 2024 10 · Yassine Kebbati, Naïma Aït Oufroukh, Dalil Ichalal, Vincent Vigneron

Autonomous driving is a complex and highly dynamic process that ensures controlling the coupled longitudinal and lateral vehicle dynamics. Model predictive control, distinguished by its predictive feature, optimal perfor…

Autonomous Driving Model Predictive Control