Barrier Function-based Safe Reinforcement Learning for Emergency Control of Power Systems

2021-03-26 · Thanh Long Vu, Sayak Mukherjee, Renke Huang, Qiuhua Hung

Under voltage load shedding has been considered as a standard and effective measure to recover the voltage stability of the electric power grid under emergency and severe conditions. However, this scheme usually trips a massive amount of load which can be unnecessary and harmful to customers. Recently, deep reinforcement learning (RL) has been regarded and adopted as a promising approach that can significantly reduce the amount of load shedding. However, like most existing machine learning (ML)-based control techniques, RL control usually cannot guarantee the safety of the systems under control. In this paper, we introduce a novel safe RL method for emergency load shedding of power systems, that can enhance the safe voltage recovery of the electric power grid after experiencing faults. Unlike the standard RL method, the safe RL method has a reward function consisting of a Barrier function that goes to minus infinity when the system state goes to the safety bounds. Consequently, the optimal control policy, that maximizes the reward function, can render the power system to avoid the safety bounds. This method is general and can be applied to other safety-critical control problems. Numerical simulations on the 39-bus IEEE benchmark is performed to demonstrate the effectiveness of the proposed safe RL emergency control, as well as its adaptive capability to faults not seen in the training.

📄 PDF Abstract BibTeX arXiv:2103.14186

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)Safe Reinforcement Learning

Safe Reinforcement Learning for Grid Voltage Control

2021-12-02 · Thanh Long Vu, Sayak Mukherjee, Renke Huang, Qiuhua Huang

Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load ineffi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Learning Control Barrier Functions and their application in Reinforcement Learning: A Survey

2024-04-22 · Maeva Guerrier, Hassan Fouad, Giovanni Beltrame

Reinforcement learning is a powerful technique for developing new robot behaviors. However, typical lack of safety guarantees constitutes a hurdle for its practical application on real robots. To address this issue, safe…

Lifelong learning reinforcement-learning Reinforcement Learning Safe Reinforcement Learning

Safe Reinforcement Learning with Probabilistic Control Barrier Functions for Ramp Merging

2022-12-01 · Soumith Udatha, Yiwei Lyu, John Dolan

Prior work has looked at applying reinforcement learning and imitation learning approaches to autonomous driving scenarios, but either the safety or the efficiency of the algorithm is compromised. With the use of control…

Autonomous Driving Imitation Learning reinforcement-learning Reinforcement Learning+2

Kernel-Based Safe Exploration in Deep Reinforcement Learning

2026-05-21 · Rupak Majumdar, Nikhil Singh, Sadegh Soudjani arxiv

Safety has been a major concern when deploying deep reinforcement learning algorithms in the real world. A promising direction that ensures that the learned policy does not visit unsafe regions is to learn a \emph{barrie…

Reinforcement Learning Continuous Control

Safety aware model-based reinforcement learning for optimal control of a class of output-feedback nonlinear systems

2021-10-01 · S M Nahid Mahmud, Moad Abudia, Scott A Nivison, Zachary I. Bell 외

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirement…

Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)