홈 › Papers

Improving a Proportional Integral Controller with Reinforcement Learning on a Throttle Valve Benchmark

2024-02-21 · Paul Daoudi, Bojan Mavkov, Bogdan Robu, Christophe Prieur, Emmanuel Witrant, Merwan Barlier, Ludovic Dos Santos

This paper presents a learning-based control strategy for non-linear throttle valves with an asymmetric hysteresis, leading to a near-optimal controller without requiring any prior knowledge about the environment. We start with a carefully tuned Proportional Integrator (PI) controller and exploit the recent advances in Reinforcement Learning (RL) with Guides to improve the closed-loop behavior by learning from the additional interactions with the valve. We test the proposed control method in various scenarios on three different valves, all highlighting the benefits of combining both PI and RL frameworks to improve control performance in non-linear stochastic systems. In all the experimental test cases, the resulting agent has a better sample efficiency than traditional RL agents and outperforms the PI controller.

📄 PDF Abstract BibTeX arXiv:2402.13654

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning (RL)

Reinforcement Learning for Control of Valves

2020-12-29 · Rajesh Siraskar

This paper is a study of reinforcement learning (RL) as an optimal-control strategy for control of nonlinear valves. It is evaluated against the PID (proportional-integral-derivative) strategy, using a unified framework.…

OpenAI Gym reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Low-Cost Throttle-By-Wire-System Architecture For Two-Wheeler Vehicles

2023-04-28 · Jannis Kreß, Jens Rau, Hektor Hebert, Fernando Perez-Peña 외

This paper investigates the performance of a lowcost Throttle-by-Wire-System (TbWS) for two-wheeler applications. Mopeds/scooters are still restricted environmentally harmful. Throttle-by-Wire-Systems can contribute to e…

Position Vocal Bursts Valence Prediction

Vulnerability of Building Energy Management against Targeted False Data Injection Attacks:Model Predictive Control vs. Proportional Integral

2023-12-06 · Xiaoyu Ge, Kamelia Norouzi, Faegheh Moazeni, Mirel Sehic 외

Cybersecurity in building energy management is crucial for protecting infrastructure, ensuring data integrity, and preventing unauthorized access or manipulation. This paper investigates the energy efficiency and cyberse…

energy management Management Model Predictive Control

Accelerate Reinforcement Learning with PID Controllers in the Pendulum Simulations

2022-10-03 · Liping Bai

We propose a Proportional Integral Derivative (PID) controller-based coaching scheme to expedite reinforcement learning (RL).

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Model-based Chance-Constrained Reinforcement Learning via Separated Proportional-Integral Lagrangian

2021-08-26 · Baiyu Peng, Jingliang Duan, Jianyu Chen, Shengbo Eben Li 외

Safety is essential for reinforcement learning (RL) applied in the real world. Adding chance constraints (or probabilistic constraints) is a suitable way to enhance RL safety under uncertainty. Existing chance-constraine…

reinforcement-learning Reinforcement Learning (RL)Robot Navigation