Multi-Objective Reinforcement Learning for Power Grid Topology Control

2025-01-27 · Thomas Lautenbacher, Ali Rajaei, Davide Barbieri, Jan Viebahn, Jochen L. Cremer

Transmission grid congestion increases as the electrification of various sectors requires transmitting more power. Topology control, through substation reconfiguration, can reduce congestion but its potential remains under-exploited in operations. A challenge is modeling the topology control problem to align well with the objectives and constraints of operators. Addressing this challenge, this paper investigates the application of multi-objective reinforcement learning (MORL) to integrate multiple conflicting objectives for power grid topology control. We develop a MORL approach using deep optimistic linear support (DOL) and multi-objective proximal policy optimization (MOPPO) to generate a set of Pareto-optimal policies that balance objectives such as minimizing line loading, topological deviation, and switching frequency. Initial case studies show that the MORL approach can provide valuable insights into objective trade-offs and improve Pareto front approximation compared to a random search baseline. The generated multi-objective RL policies are 30% more successful in preventing grid failure under contingencies and 20% more effective when training budget is reduced - compared to the common single objective RL policy.

📄 PDF Abstract BibTeX arXiv:2502.00040

Code (1)

tu-delft-ai-energy-lab/topgrid_morl 공식 구현

Tasks

Multi-Objective Reinforcement Learningreinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

Random Search Random Search replaces the exhaustive enumeration of all combinations by selecting them randomly. This can be simply applied to the discrete setting described above, but also…

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Towards Efficient Multi-Objective Optimisation for Real-World Power Grid Topology Control

2025-01-24 · Yassine El Manyari, Anton R. Fuxjager, Stefan Zahlner, Joost van Dijk 외

Power grid operators face increasing difficulties in the control room as the increase in energy demand and the shift to renewable energy introduce new complexities in managing congestion and maintaining a stable supply. …

Multi-Objective Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MxGPS: Multiplex Graph Transformers for a Power Grid Foundation Model

2026-07-15 · Charilaos Papaioannou, Ioannis Tsantilas, Dimitris Giannakakos, Vasilis Michalakopoulos 외 arxiv

Single-task fine-tuning of graph neural networks (GNNs) for power grid problems exhibits a systematic failure mode: models that achieve the lowest in-distribution error degrade the most under topology shift. We term this…

Fully Decentralized Reinforcement Learning-based Control of Photovoltaics in Distribution Grids for Joint Provision of Real and Reactive Power

2020-08-03 · Rayan El Helou, Dileep Kalathil, Le Xie

In this paper, we introduce a new framework to address the problem of voltage regulation in unbalanced distribution grids with deep photovoltaic penetration. In this framework, both real and reactive power setpoints are …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approach

2024-05-01 · Malte Lehna, Clara Holzhüter, Sven Tomforde, Christoph Scholz

With the growth of Renewable Energy (RE) generation, the operation of power grids has become increasingly complex. One solution could be automated grid operation, where Deep Reinforcement Learning (DRL) has repeatedly sh…

Deep Reinforcement Learning

Multi-Objective Reinforcement Learning based Multi-Microgrid System Optimisation Problem

2021-03-10 · Jiangjiao Xu, Ke Li, Mohammad Abusara

Microgrids with energy storage systems and distributed renewable energy sources play a crucial role in reducing the consumption from traditional power sources and the emission of $CO_2$. Connecting multi microgrid to a d…

energy management Management Multi-Objective Reinforcement Learning reinforcement-learning+2