Reinforcement Learning for Distributed Transient Frequency Control with Stability and Safety Guarantees
This paper proposes a reinforcement learning-based approach for optimal transient frequency control in power systems with stability and safety guarantees. Building on Lyapunov stability theory and safety-critical control, we derive sufficient conditions on the distributed controller design that ensure the stability and transient frequency safety of the closed-loop system. Our idea of distributed dynamic budget assignment makes these conditions less conservative than those in recent literature, so that they can impose less stringent restrictions on the search space of control policies. We construct neural network controllers that parameterize such control policies and use reinforcement learning to train an optimal one. Simulations on the IEEE 39-bus network illustrate the guaranteed stability and safety properties of the controller along with its significantly improved optimality.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Distributed Emergency Frequency Control Considering Transient Stability Constraints in Multi-Infeed Hybrid AC-DC System
Due to possible emergency faults and frequency regulation reserve shortage in the multi-infeed hybrid AC-DC (MIDC) system, the emergency frequency control (EFC) with LCC-HVDC systems participating is important for system…
Stable Reinforcement Learning for Optimal Frequency Control: A Distributed Averaging-Based Integral Approach
Frequency control plays a pivotal role in reliable power system operations. It is conventionally performed in a hierarchical way that first rapidly stabilizes the frequency deviations and then slowly recovers the nominal…
reinforcement-learningReinforcement Learning (RL)Federated Physics-Grounded Reinforcement Learning for Distributed Stability Control in Smart Grids
Transient stability control in smart grids requires rapid post-fault damping of generator frequency and rotor angle deviations to prevent cascading failures. This paper proposes FedPPO-PG, a Federated Multi-Agent Proxima…
Multi-agent Reinforcement LearningLyapunov-Regularized Reinforcement Learning for Power System Transient Stability
Transient stability of power systems is becoming increasingly important because of the growing integration of renewable resources. These resources lead to a reduction in mechanical inertia but also provide increased flex…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Fast voltage boosters to improve transient stability of power systems with 100% of grid-forming VSC-based generation
Grid-forming voltage source converter (GF-VSC) has been identified as the key technology for the operation of future converter-dominated power systems. Among many other issues, transient stability of this type of power s…