paper-with-me

홈 › Papers

RL2Grid: Benchmarking Reinforcement Learning in Power Grid Operations

2025-03-29 · Enrico Marchesini, Benjamin Donnot, Constance Crozier, Ian Dytham, Christian Merz, Lars Schewe, Nico Westerbeck, Cathy Wu, Antoine Marot, Priya L. Donti

Reinforcement learning (RL) can transform power grid operations by providing adaptive and scalable controllers essential for grid decarbonization. However, existing methods struggle with the complex dynamics, aleatoric uncertainty, long-horizon goals, and hard physical constraints that occur in real-world systems. This paper presents RL2Grid, a benchmark designed in collaboration with power system operators to accelerate progress in grid control and foster RL maturity. Built on a power simulation framework developed by RTE France, RL2Grid standardizes tasks, state and action spaces, and reward structures within a unified interface for a systematic evaluation and comparison of RL approaches. Moreover, we integrate real control heuristics and safety constraints informed by the operators' expertise to ensure RL2Grid aligns with grid operation requirements. We benchmark popular RL baselines on the grid control tasks represented within RL2Grid, establishing reference performance metrics. Our results and discussion highlight the challenges that power grids pose for RL methods, emphasizing the need for novel algorithms capable of handling real-world physical systems.

📄 PDF Abstract BibTeX arXiv:2503.23101

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarkingreinforcement-learningReinforcement LearningReinforcement Learning (RL)RTE

Similar Papers 제목 키워드 기반

PowerGraph: A power grid benchmark dataset for graph neural networks

2024-02-05 · Anna Varbella, Kenza Amara, Blazhe Gjorgiev, Mennatallah El-Assady 외

Power grids are critical infrastructures of paramount importance to modern society and, therefore, engineered to operate under diverse conditions and failures. The ongoing energy transition poses new challenges for the d…

ArticlesBenchmarkingBinary ClassificationMulti-class Classification

Towards Efficient Multi-Objective Optimisation for Real-World Power Grid Topology Control

2025-01-24 · Yassine El Manyari, Anton R. Fuxjager, Stefan Zahlner, Joost van Dijk 외

Power grid operators face increasing difficulties in the control room as the increase in energy demand and the shift to renewable energy introduce new complexities in managing congestion and maintaining a stable supply. …

Multi-Objective Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Deep Reinforcement Learning for Power Grid Multi-Stage Cascading Failure Mitigation

2025-05-13 · Bo Meng, Chenghao Xu, Yongli Zhu

Cascading failures in power grids can lead to grid collapse, causing severe disruptions to social operations and economic activities. In certain cases, multi-stage cascading failures can occur. However, existing cascadin…

Deep Reinforcement Learningreinforcement-learningReinforcement Learning

Implementing Deep Reinforcement Learning-Based Grid Voltage Control in Real-World Power Systems: Challenges and Insights

2024-10-24 · Di Shi, Qiang Zhang, Mingguo Hong, Fengyu Wang 외

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplor…

Deep Reinforcement LearningManagement

Exploring the Use of Autonomous Unmanned Vehicles for Supporting Power Grid Operations

2024-11-14 · Yuqi Zhou, Cong Feng, Mingzhi Zhang, Rui Yang

This paper explores the use of autonomous unmanned vehicles to support power grid operations. With built-in batteries and the capability to carry additional battery energy storage, the rising number of autonomous vehicle…

Autonomous Vehicles