RL2Grid: Benchmarking Reinforcement Learning in Power Grid Operations
Reinforcement learning (RL) can transform power grid operations by providing adaptive and scalable controllers essential for grid decarbonization. However, existing methods struggle with the complex dynamics, aleatoric uncertainty, long-horizon goals, and hard physical constraints that occur in real-world systems. This paper presents RL2Grid, a benchmark designed in collaboration with power system operators to accelerate progress in grid control and foster RL maturity. Built on a power simulation framework developed by RTE France, RL2Grid standardizes tasks, state and action spaces, and reward structures within a unified interface for a systematic evaluation and comparison of RL approaches. Moreover, we integrate real control heuristics and safety constraints informed by the operators' expertise to ensure RL2Grid aligns with grid operation requirements. We benchmark popular RL baselines on the grid control tasks represented within RL2Grid, establishing reference performance metrics. Our results and discussion highlight the challenges that power grids pose for RL methods, emphasizing the need for novel algorithms capable of handling real-world physical systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Benchmarkingreinforcement-learningReinforcement LearningReinforcement Learning (RL)RTESimilar Papers 제목 키워드 기반
PowerGraph: A power grid benchmark dataset for graph neural networks
Power grids are critical infrastructures of paramount importance to modern society and, therefore, engineered to operate under diverse conditions and failures. The ongoing energy transition poses new challenges for the d…
ArticlesBenchmarkingBinary ClassificationMulti-class ClassificationTowards Efficient Multi-Objective Optimisation for Real-World Power Grid Topology Control
Power grid operators face increasing difficulties in the control room as the increase in energy demand and the shift to renewable energy introduce new complexities in managing congestion and maintaining a stable supply. …
Multi-Objective Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Deep Reinforcement Learning for Power Grid Multi-Stage Cascading Failure Mitigation
Cascading failures in power grids can lead to grid collapse, causing severe disruptions to social operations and economic activities. In certain cases, multi-stage cascading failures can occur. However, existing cascadin…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningImplementing Deep Reinforcement Learning-Based Grid Voltage Control in Real-World Power Systems: Challenges and Insights
Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplor…
Deep Reinforcement LearningManagementExploring the Use of Autonomous Unmanned Vehicles for Supporting Power Grid Operations
This paper explores the use of autonomous unmanned vehicles to support power grid operations. With built-in batteries and the capability to carry additional battery energy storage, the rising number of autonomous vehicle…
Autonomous Vehicles