Learning to run a power network challenge for training topology controllers
For power grid operations, a large body of research focuses on using generation redispatching, load shedding or demand side management flexibilities. However, a less costly and potentially more flexible option would be grid topology reconfiguration, as already partially exploited by Coreso (European RSC) and RTE (French TSO) operations. Beyond previous work on branch switching, bus reconfigurations are a broader class of action and could provide some substantial benefits to route electricity and optimize the grid capacity to keep it within safety margins. Because of its non-linear and combinatorial nature, no existing optimal power flow solver can yet tackle this problem. We here propose a new framework to learn topology controllers through imitation and reinforcement learning. We present the design and the results of the first "Learning to Run a Power Network" challenge released with this framework. We finally develop a method providing performance upper-bounds (oracle), which highlights remaining unsolved challenges and suggests future directions of improvement.
Code (0)
등록된 구현이 없습니다.
Tasks
ManagementReinforcement LearningRTESimilar Papers 제목 키워드 기반
Curriculum Based Reinforcement Learning of Grid Topology Controllers to Prevent Thermal Cascading
This paper describes how domain knowledge of power system operators can be integrated into reinforcement learning (RL) frameworks to effectively learn agents that control the grid's topology to prevent thermal cascading.…
reinforcement-learningReinforcement Learning (RL)RTEECToNAS: Evolutionary Cross-Topology Neural Architecture Search
We present ECToNAS, a cost-efficient evolutionary cross-topology neural architecture search algorithm that does not require any pre-trained meta controllers. Our framework is able to select suitable network architectures…
Neural Architecture SearchHierarchical Reinforcement Learning for Power Network Topology Control
Learning in high-dimensional action spaces is a key challenge in applying reinforcement learning (RL) to real-world systems. In this paper, we study the possibility of controlling power networks using RL methods. Power n…
AllHierarchical Reinforcement Learningreinforcement-learningReinforcement Learning+1Communication Topology Co-Design in Graph Recurrent Neural Network Based Distributed Control
When designing large-scale distributed controllers, the information-sharing constraints between sub-controllers, as defined by a communication topology interconnecting them, are as important as the controller itself. Con…
Graph Neural NetworkDissipativity-Based Distributed Control and Communication Topology Co-Design for DC Microgrids with ZIP Loads
This paper presents a novel dissipativity-based distributed droop-free control and communication topology co-design approach for voltage regulation and current sharing in DC microgrids (DC MGs) with generic ``ZIP'' loads…