Bayesian Reinforcement Learning for Automatic Voltage Control under Cyber-Induced Uncertainty

2023-05-25 · Abhijeet Sahu, Katherine Davis

Voltage control is crucial to large-scale power system reliable operation, as timely reactive power support can help prevent widespread outages. However, there is currently no built in mechanism for power systems to ensure that the voltage control objective to maintain reliable operation will survive or sustain the uncertainty caused under adversary presence. Hence, this work introduces a Bayesian Reinforcement Learning (BRL) approach for power system control problems, with focus on sustained voltage control under uncertainty in a cyber-adversarial environment. This work proposes a data-driven BRL-based approach for automatic voltage control by formulating and solving a Partially-Observable Markov Decision Problem (POMDP), where the states are partially observable due to cyber intrusions. The techniques are evaluated on the WSCC and IEEE 14 bus systems. Additionally, BRL techniques assist in automatically finding a threshold for exploration and exploitation in various RL techniques.

📄 PDF Abstract BibTeX arXiv:2305.16469

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Safe Reinforcement Learning for Grid Voltage Control

2021-12-02 · Thanh Long Vu, Sayak Mukherjee, Renke Huang, Qiuhua Huang

Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load ineffi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Stability Constrained Reinforcement Learning for Real-Time Voltage Control

2021-09-30 · Yuanyuan Shi, Guannan Qu, Steven Low, Anima Anandkumar 외

Deep reinforcement learning (RL) has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Stability Constrained Reinforcement Learning for Decentralized Real-Time Voltage Control

2022-09-16 · Jie Feng, Yuanyuan Shi, Guannan Qu, Steven H. Low 외

Deep reinforcement learning has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of expl…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Automatic Self-Adaptive Local Voltage Control Under Limited Reactive Power

2022-06-18 · Rui Cheng, Naihao Shi, Salish Maharjan, Zhaoyu Wang

The increasing proliferation of distributed energy resources has posed new challenges to Volt/VAr control problems in distribution networks. To this end, this paper proposes an automatic self-adaptive local voltage contr…

Adaptive Load Shedding for Grid Emergency Control via Deep Reinforcement Learning

2021-02-25 · Ying Zhang, Meng Yue, Jianhui Wang

Emergency control, typically such as under-voltage load shedding (UVLS), is broadly used to grapple with low voltage and voltage instability issues in practical power systems under contingencies. However, existing emerge…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)