Stability Constrained Reinforcement Learning for Real-Time Voltage Control

2021-09-30 · Yuanyuan Shi, Guannan Qu, Steven Low, Anima Anandkumar, Adam Wierman

Deep reinforcement learning (RL) has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of formal stability and safety guarantees. In this paper, we propose a stability constrained reinforcement learning method for real-time voltage control in distribution grids and we prove that the proposed approach provides a formal voltage stability guarantee. The key idea underlying our approach is an explicitly constructed Lyapunov function that certifies stability. We demonstrate the effectiveness of the approach in case studies, where the proposed method can reduce the transient control cost by more than 30\% and shorten the response time by a third compared to a widely used linear policy, while always achieving voltage stability. In contrast, standard RL methods often fail to achieve voltage stability.

📄 PDF Abstract BibTeX arXiv:2109.14854

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Stability Constrained Reinforcement Learning for Decentralized Real-Time Voltage Control

2022-09-16 · Jie Feng, Yuanyuan Shi, Guannan Qu, Steven H. Low 외

Deep reinforcement learning has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of expl…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Safe Reinforcement Learning for Grid Voltage Control

2021-12-02 · Thanh Long Vu, Sayak Mukherjee, Renke Huang, Qiuhua Huang

Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load ineffi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Safety Constrained Multi-Agent Reinforcement Learning for Active Voltage Control

2024-05-14 · Yang Qu, Jinming Ma, Feng Wu

Active voltage control presents a promising avenue for relieving power congestion and enhancing voltage quality, taking advantage of the distributed controllable generators in the power network, such as roof-top photovol…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Voltage Stability Constrained Unit Commitment in High IBG-Penetrated Power Systems

2021-12-06 · Zhongda Chu, Fei Teng

With the increasing penetration of renewable energy sources, power system operation has to be adapted to ensure the system stability and security while considering the distinguished feature of the Power Electronics (PE) …

Scheduling Vocal Bursts Intensity Prediction

VRA: Grounding Discrete-Time Joint Acceleration in Voltage-Constrained Actuation

2026-05-11 · Lingwei Zhang, Jiaming Wang, Tianlin Zhang, Zhitao Song 외 arxiv

Discrete-time joint acceleration constraints are widely used to enforce position and velocity limits. However, under voltage-constrained electric actuators, kinematically admissible accelerations may be physically unreal…