Multi-Stage Transmission Line Flow Control Using Centralized and Decentralized Reinforcement Learning Agents
Planning future operational scenarios of bulk power systems that meet security and economic constraints typically requires intensive labor efforts in performing massive simulations. To automate this process and relieve engineers' burden, a novel multi-stage control approach is presented in this paper to train centralized and decentralized reinforcement learning agents that can automatically adjust grid controllers for regulating transmission line flows at normal condition and under contingencies. The power grid flow control problem is formulated as Markov Decision Process (MDP). At stage one, centralized soft actor-critic (SAC) agent is trained to control generator active power outputs in a wide area to control transmission line flows against specified security limits. If line overloading issues remain unresolved, stage two is used to train decentralized SAC agent via load throw-over at local substations. The effectiveness of the proposed approach is verified on a series of actual planning cases used for operating the power grid of SGCC Zhejiang Electric Power Company.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-Flow Transmission in Wireless Interference Networks: A Convergent Graph Learning Approach
We consider the problem of of multi-flow transmission in wireless networks, where data signals from different flows can interfere with each other due to mutual interference between links along their routes, resulting in …
Graph LearningGraph Neural NetworkReinforcement Learning (RL)Impacts of Variable-Impedance-Based Power Flow Control on Renewable Energy Integration
The electric power grid has evolved significantly over the past two decades in response to climate change. Increased levels of renewable energy generation, as a prominent feature of this evolution, have led to new conges…
Design and Stability of Angle based Feedback Control in Power Systems: A Negative-Imaginary Approach
This paper considers a power transmission network characterized by interconnected nonlinear swing dynamics on generator buses. At the steady state, frequencies across different buses synchronize to a common nominal value…
Modeling and Rapid Prototyping of Integrated Transmission-Distribution OPF Formulations with PowerModelsITD.jl
Conventional electric power systems are composed of different unidirectional power flow stages of generation, transmission, and distribution, managed independently by transmission system and distribution system operators…
Low Frequency AC Transmission Upgrades with Optimal Frequency Selection
The advantages of operating selected transmission lines at frequencies other than the standard 50 or 60 Hz are numerous, encompassing increased power transfer capacity and better utilization of existing infrastructure. W…