Constrained Reinforcement Learning for Predictive Control in Real-Time Stochastic Dynamic Optimal Power Flow

2023-02-21 · Tong Wu, Anna Scaglione, Daniel Arnold

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the reward function. However, this approach can lead to infeasible solutions that violate physical constraints such as power flow equations, voltage limits, and dynamic constraints. Ensuring these constraints are met is crucial in power systems, as they are a safety critical infrastructure. To address this issue, existing DRL algorithms remedy the problem by projecting the actions onto the feasible set, which can result in sub-optimal solutions. This paper presents a novel primal-dual approach for learning optimal constrained DRL policies for dynamic optimal power flow problems, with the aim of controlling power generations and battery outputs. We also prove the convergence of the critic and actor networks. Our case studies on IEEE standard systems demonstrate the superiority of the proposed approach in dynamically adapting to the environment while maintaining safety constraints.

📄 PDF Abstract BibTeX arXiv:2302.10382

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)

A predictive safety filter for learning-based control of constrained nonlinear dynamical systems

2018-12-13 · Kim P. Wabersich, Melanie N. Zeilinger

The transfer of reinforcement learning (RL) techniques into real-world applications is challenged by safety requirements in the presence of physical limitations. Most RL methods, in particular the most popular algorithms…

Model Predictive Control Reinforcement Learning Reinforcement Learning (RL)Safe Exploration

Deep Reinforcement Learning-Enhanced Event-Triggered Data-Driven Predictive Control for a 3D Cable-Driven Soft Robotic Arm

2026-06-24 · Cheng Ouyang, Moeen Ul Islam, Kaixiang Zhang, Zhaojian Li 외 arxiv

Soft robots are challenging to control due to their nonlinear and time-varying dynamics. Data-enabled predictive control (DeePC) offers a model-free alternative by directly leveraging measured input-output trajectories t…

Reinforcement Learning

Safe Reinforcement Learning with Chance-constrained Model Predictive Control

2021-12-27 · Samuel Pfrommer, Tanmay Gautam, Alec Zhou, Somayeh Sojoudi

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive co…

Model Predictive Control reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Safety Reinforced Model Predictive Control (SRMPC): Improving MPC with Reinforcement Learning for Motion Planning in Autonomous Driving

2025-12-03 · Johannes Fischer, Marlon Steiner, Ömer Sahin Tas, Christoph Stiller arxiv

Model predictive control (MPC) is widely used for motion planning, particularly in autonomous driving. Real-time capability of the planner requires utilizing convex approximation of optimal control problems (OCPs) for th…

Reinforcement Learning Autonomous Driving Motion Planning

Predictive Lagrangian Optimization for Constrained Reinforcement Learning

2025-01-25 · Tianqi Zhang, Puzhen Yuan, Guojian Zhan, Ziyu Lin 외

Constrained optimization is popularly seen in reinforcement learning for addressing complex control tasks. From the perspective of dynamic system, iteratively solving a constrained optimization problem can be framed as t…

Model Predictive Control reinforcement-learning Reinforcement Learning