Stability Constrained Reinforcement Learning for Decentralized Real-Time Voltage Control

2022-09-16 · Jie Feng, Yuanyuan Shi, Guannan Qu, Steven H. Low, Anima Anandkumar, Adam Wierman

Deep reinforcement learning has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of explicit stability and safety guarantees. In this paper, we propose a stability-constrained reinforcement learning (RL) method for real-time voltage control, that guarantees system stability both during policy learning and deployment of the learned policy. The key idea underlying our approach is an explicitly constructed Lyapunov function that leads to a sufficient structural condition for stabilizing policies, i.e., monotonically decreasing policies guarantee stability. We incorporate this structural constraint with RL, by parameterizing each local voltage controller using a monotone neural network, thus ensuring the stability constraint is satisfied by design. We demonstrate the effectiveness of our approach in both single-phase and three-phase IEEE test feeders, where the proposed method can reduce the transient control cost by more than 25% and shorten the voltage recovery time by 21.5% on average compared to the widely used linear policy, while always achieving voltage stability. In contrast, standard RL methods often fail to achieve voltage stability.

📄 PDF Abstract BibTeX arXiv:2209.07669

Code (1)

jiefeng-cse/stable-ddpg-for-voltage-control 공식 구현 pytorch

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Test 설명 없음

Lyapunov-Based Reinforcement Learning for Decentralized Multi-Agent Control

2020-09-20 · Qingrui Zhang, Hao Dong, Wei Pan

Decentralized multi-agent control has broad applications, ranging from multi-robot cooperation to distributed sensor networks. In decentralized multi-agent control, systems are complex with unknown or highly uncertain dy…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Stability Constrained Reinforcement Learning for Real-Time Voltage Control

2021-09-30 · Yuanyuan Shi, Guannan Qu, Steven Low, Anima Anandkumar 외

Deep reinforcement learning (RL) has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Online Multi-agent Reinforcement Learning for Decentralized Inverter-based Volt-VAR Control

2020-06-23 · Haotian Liu, Wenchuan Wu

The distributed Volt/Var control (VVC) methods have been widely studied for active distribution networks(ADNs), which is based on perfect model and real-time P2P communication. However, the model is always incomplete wit…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Federated Physics-Grounded Reinforcement Learning for Distributed Stability Control in Smart Grids

2026-07-06 · Omar Al-Refai, Ibrahim Shahbaz, Adam Ali Husseinat, Eman Hammad arxiv

Transient stability control in smart grids requires rapid post-fault damping of generator frequency and rotor angle deviations to prevent cascading failures. This paper proposes FedPPO-PG, a Federated Multi-Agent Proxima…

Multi-agent Reinforcement Learning

HALO: Learning Human-Robot Collaboration via Heterogeneous-Agent Lyapunov Policy Optimization

2026-03-04 · Hao Zhang, Yaru Niu, Yikai Wang, Ding Zhao 외 arxiv

To improve generalization and resilience in human-robot collaboration (HRC), robots must contend with diverse combinations of human behaviors and contexts, motivating multi-agent reinforcement learning (MARL). However, i…