홈 › Papers

A Reinforcement Learning Engine with Reduced Action and State Space for Scalable Cyber-Physical Optimal Response

2024-10-06 · Shining Sun, Khandaker Akramul Haque, Xiang Huo, Leen Al Homoud, Shamina Hossain-McKenzie, Ana Goulart, Katherine Davis

Numerous research studies have been conducted to enhance the resilience of cyber-physical systems (CPSs) by detecting potential cyber or physical disturbances. However, the development of scalable and optimal response measures under power system contingency based on fusing cyber-physical data is still in an early stage. To address this research gap, this paper introduces a power system response engine based on reinforcement learning (RL) and role and interaction discovery (RID) techniques. RL-RID-GridResponder is designed to automatically detect the contingency and assist with the decision-making process to ensure optimal power system operation. The RL-RID-GridResponder learns via an RL-based structure and achieves enhanced scalability by integrating an RID module with reduced action and state spaces. The applicability of RL-RID-GridResponder in providing scalable and optimal responses for CPSs is demonstrated on power systems in the context of Denial of Service (DoS) attacks. Moreover, simulations are conducted on a Volt-Var regulation problem using the augmented WSCC 9-bus and augmented IEEE 24-bus systems based on fused cyber and physical data sets. The results show that the proposed RL-RID-GridResponder can provide fast and accurate responses to ensure optimal power system operation under DoS and can extend to other system contingencies such as line outages and loss of loads.

📄 PDF Abstract BibTeX arXiv:2410.04518

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

VAM: Verbalized Action Masking for Controllable Exploration in RL Post-Training -- A Chess Case Study

2026-02-18 · Zhicheng Zhang, Ziyan Wang, Yali Du, Fei Fang arxiv

Exploration remains a key bottleneck for reinforcement learning (RL) post-training of large language models (LLMs), where sparse feedback and large action spaces can lead to premature collapse into repetitive behaviors. …

Reinforcement Learning

Extreme State Aggregation Beyond MDPs

2014-07-12 · Marcus Hutter

We consider a Reinforcement Learning setup where an agent interacts with an environment in observation-reward-action cycles without any (esp.\ MDP) assumptions on the environment. State aggregation and more generally fea…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning

2018-12-04 · NAACL 2019 6 · Prithviraj Ammanabrolu, Mark O. Riedl

Text-based adventure games provide a platform on which to explore reinforcement learning in the context of a combinatorial action space, such as natural language. We present a deep reinforcement learning architecture tha…

Deep Reinforcement Learning Efficient Exploration Question Answering reinforcement-learning+3

Managing engineering systems with large state and action spaces through deep reinforcement learning

2018-11-05 · C. P. Andriotis, K. G. Papakonstantinou

Decision-making for engineering systems can be efficiently formulated as a Markov Decision Process (MDP) or a Partially Observable MDP (POMDP). Typical MDP and POMDP solution procedures utilize offline knowledge about th…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning

2021-10-26 · NeurIPS 2021 12 · Junsu Kim, Younggyo Seo, Jinwoo Shin

Goal-conditioned hierarchical reinforcement learning (HRL) has shown promising results for solving complex and long-horizon RL tasks. However, the action space of high-level policy in the goal-conditioned HRL is often la…

Efficient Exploration Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+1