Accelerated Deep Reinforcement Learning Based Load Shedding for Emergency Voltage Control

2020-06-22 · Renke Huang, Yujiao Chen, Tianzhixi Yin, Xinya Li, Ang Li, Jie Tan, Wenhao Yu, YuAn Liu, Qiuhua Huang

Load shedding has been one of the most widely used and effective emergency control approaches against voltage instability. With increased uncertainties and rapidly changing operational conditions in power systems, existing methods have outstanding issues in terms of either speed, adaptiveness, or scalability. Deep reinforcement learning (DRL) was regarded and adopted as a promising approach for fast and adaptive grid stability control in recent years. However, existing DRL algorithms show two outstanding issues when being applied to power system control problems: 1) computational inefficiency that requires extensive training and tuning time; and 2) poor scalability making it difficult to scale to high dimensional control problems. To overcome these issues, an accelerated DRL algorithm named PARS was developed and tailored for power system voltage stability control via load shedding. PARS features high scalability and is easy to tune with only five main hyperparameters. The method was tested on both the IEEE 39-bus and IEEE 300-bus systems, and the latter is by far the largest scale for such a study. Test results show that, compared to other methods including model-predictive control (MPC) and proximal policy optimization(PPO) methods, PARS shows better computational efficiency (faster convergence), more robustness in learning, excellent scalability and generalization capability.

📄 PDF Abstract BibTeX arXiv:2006.12667

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyDeep Reinforcement LearningModel Predictive Controlreinforcement-learning Reinforcement Learning (RL)

Adaptive Load Shedding for Grid Emergency Control via Deep Reinforcement Learning

2021-02-25 · Ying Zhang, Meng Yue, Jianhui Wang

Emergency control, typically such as under-voltage load shedding (UVLS), is broadly used to grapple with low voltage and voltage instability issues in practical power systems under contingencies. However, existing emerge…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Barrier Function-based Safe Reinforcement Learning for Emergency Control of Power Systems

2021-03-26 · Thanh Long Vu, Sayak Mukherjee, Renke Huang, Qiuhua Hung

Under voltage load shedding has been considered as a standard and effective measure to recover the voltage stability of the electric power grid under emergency and severe conditions. However, this scheme usually trips a …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Safe Reinforcement Learning

Safe Reinforcement Learning for Grid Voltage Control

2021-12-02 · Thanh Long Vu, Sayak Mukherjee, Renke Huang, Qiuhua Huang

Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load ineffi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Cooperative Multi-Agent Deep Reinforcement Learning for Adaptive Decentralized Emergency Voltage Control

2023-10-20 · Ying Zhang, Meng Yue

Under voltage load shedding (UVLS) for power grid emergency control builds the last defensive perimeter to prevent cascade outages and blackouts in case of contingencies. This letter proposes a novel cooperative multi-ag…

Deep Reinforcement Learning reinforcement-learning

Adaptive Power System Emergency Control using Deep Reinforcement Learning

2019-03-09 · Qiuhua Huang, Renke Huang, Weituo Hao, Jie Tan 외

Power system emergency control is generally regarded as the last safety net for grid security and resiliency. Existing emergency control schemes are usually designed off-line based on either the conceived "worst" case sc…

Benchmarking Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1