paper-with-me

Papers

Steady-State Error Compensation for Reinforcement Learning with Quadratic Rewards

2024-02-14 · Liyao Wang, Zishun Zheng, Yuan Lin

The selection of a reward function in Reinforcement Learning (RL) has garnered significant attention because of its impact on system performance. Issues of significant steady-state errors often manifest when quadratic reward functions are employed. Although absolute-value-type reward functions alleviate this problem, they tend to induce substantial fluctuations in specific system states, leading to abrupt changes. In response to this challenge, this study proposes an approach that introduces an integral term. By integrating this integral term into quadratic-type reward functions, the RL algorithm is adeptly tuned, augmenting the system's consideration of reward history, and consequently alleviates concerns related to steady-state errors. Through experiments and performance evaluations on the Adaptive Cruise Control (ACC) and lane change models, we validate that the proposed method effectively diminishes steady-state errors and does not cause significant spikes in some system states.

📄 PDF Abstract BibTeX arXiv:2402.09075

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Steady-State Error Compensation in Reference Tracking and Disturbance Rejection Problems for Reinforcement Learning-Based Control

2022-01-31 · Daniel Weber, Maximilian Schenke, Oliver Wallscheid

Reinforcement learning (RL) is a promising, upcoming topic in automatic control applications. Where classical control approaches require a priori system knowledge, data-driven control approaches like RL allow a model-fre…

Model Predictive ControlReinforcement Learning (RL)

Design and Performance Analysis of a Class of Generalized Predictive Controllers

2023-11-06 · Feilong Zhang

The design and structure of generalized predictive control (GPC) are not simple and intuitive. The performance analysis does not deeply analyze how the controller parameters affect the system characteristics and the rela…

Design and comparison of two linear controllers with precompensation gain for the Quadruple inverted pendulum

2022-02-28 · Franklin Josue Ticona Coaquira

In this work we present a workflow for designing two linear control techniques applied to the dynamic system quadruple inverted pendulum mounted on a cart (QIP) where the steady state error on cart position is eliminated…

Position

Compressed Gradient Methods with Hessian-Aided Error Compensation

2019-09-23 · Sarit Khirirat, Sindri Magnússon, Mikael Johansson

The emergence of big data has caused a dramatic shift in the operating regime for optimization algorithms. The performance bottleneck, which used to be computations, is now often communications. Several gradient compress…

Online Linear Quadratic Control

2018-06-19 · ICML 2018 7 · Alon Cohen, Avinatan Hassidim, Tomer Koren, Nevena Lazic 외

We study the problem of controlling linear time-invariant systems with known noisy dynamics and adversarially chosen quadratic losses. We present the first efficient online learning algorithms in this setting that guaran…