Winning the L2RPN Challenge: Power Grid Management via Semi-Markov Afterstate Actor-Critic
Safe and reliable electricity transmission in power grids is crucial for modern society. It is thus quite natural that there has been a growing interest in the automatic management of power grids, exemplified by the Learning to Run a Power Network Challenge (L2RPN), modeling the problem as a reinforcement learning (RL) task. However, it is highly challenging to manage a real-world scale power grid, mostly due to the massive scale of its state and action space. In this paper, we present an off-policy actor-critic approach that effectively tackles the unique challenges in power grid management by RL, adopting the hierarchical policy together with the afterstate representation. Our agent ranked first in the latest challenge (L2RPN WCCI 2020), being able to avoid disastrous situations while maintaining the highest level of operational efficiency in every test scenarios. This paper provides a formal description of the algorithmic aspect of our approach, as well as further experimental studies on diverse power grids.
Code (0)
등록된 구현이 없습니다.
Tasks
ManagementReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Power Grid Congestion Management via Topology Optimization with AlphaZero
The energy sector is facing rapid changes in the transition towards clean renewable sources. However, the growing share of volatile, fluctuating renewable generation such as wind or solar energy has already led to an inc…
ManagementA Novel Real-Time Energy Management Strategy for Grid-Supporting Microgrid: Enabling Flexible Trading Power
In recent years, there has been significant growth of distributed energy resources (DERs) penetration in the power grid. The stochastic and intermittent features of variable DERs such as roof top photovoltaic (PV) bring …
energy managementManagementAn Extensive and Methodical Review of Smart Grids for Sustainable Energy Management-Addressing Challenges with AI, Renewable Energy Integration and Leading-edge Technologies
Energy management decreases energy expenditures and consumption while simultaneously increasing energy efficiency, reducing carbon emissions, and enhancing operational performance. Smart grids are a type of sophisticated…
energy managementManagementPowRL: A Reinforcement Learning Framework for Robust Management of Power Networks
Power grids, across the world, play an important societal and economical role by providing uninterrupted, reliable and transient-free power to several industries, businesses and household consumers. With the advent of re…
Decision MakingManagementreinforcement-learningReinforcement Learning (RL)An Overview of the Prospects and Challenges of Using Artificial Intelligence for Energy Management Systems in Microgrids
Microgrids have emerged as a pivotal solution in the quest for a sustainable and energy-efficient future. While microgrids offer numerous advantages, they are also prone to issues related to reliably forecasting renewabl…
energy managementManagement