paper-with-me

홈 › Papers

Fully Decentralized Reinforcement Learning-based Control of Photovoltaics in Distribution Grids for Joint Provision of Real and Reactive Power

2020-08-03 · Rayan El Helou, Dileep Kalathil, Le Xie

In this paper, we introduce a new framework to address the problem of voltage regulation in unbalanced distribution grids with deep photovoltaic penetration. In this framework, both real and reactive power setpoints are explicitly controlled at each solar panel smart inverter, and the objective is to simultaneously minimize system-wide voltage deviation and maximize solar power output. We formulate the problem as a Markov decision process with continuous action spaces and use proximal policy optimization, a reinforcement learning-based approach, to solve it, without the need for any forecast or explicit knowledge of network topology or line parameters. By representing the system in a quasi-steady state manner, and by carefully formulating the Markov decision process, we reduce the complexity of the problem and allow for fully decentralized (communication-free) policies, all of which make the trained policies much more practical and interpretable. Numerical simulations on a 240-node unbalanced distribution grid, based on a real network in Midwest U.S., are used to validate the proposed framework and reinforcement learning approach.

📄 PDF Abstract BibTeX arXiv:2008.01231

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Cooperative multi-agent reinforcement learning for high-dimensional nonequilibrium control

2021-11-12 · Shriram Chennakesavalu, Grant M. Rotskoff

Experimental advances enabling high-resolution external control create new opportunities to produce materials with exotic properties. In this work, we investigate how a multi-agent reinforcement learning approach can be …

Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Decentralized Smart Charging of Large-Scale EVs using Adaptive Multi-Agent Multi-Armed Bandits

2023-07-20 · Sharyal Zafar, Raphaël Feraud, Anne Blavette, Guy Camilleri 외

The drastic growth of electric vehicles and photovoltaics can introduce new challenges, such as electrical current congestion and voltage limit violations due to peak load demands. These issues can be mitigated by contro…

FairnessMulti-Armed BanditsPhilosophy

Distributed flexibility as a cost-effective alternative to grid reinforcement

2021-09-15 · Jordan Holweger, Christophe Ballif, Nicolas Wyrsch

The deployment of distributed photovoltaics (PV) in low-voltage networks may cause technical issues such as voltage rises, line ampacity violations, and transformer overloading for distribution system operators (DSOs). T…

Optimization-based framework for low-voltage grid reinforcement assessment under various levels of flexibility and coordination

2022-09-08 · Soner Candas, Beneharo Reveron Baecker, Anurag Mohapatra, Thomas Hamacher

The rapid electrification of residential heating and mobility sectors is expected to drive the existing distribution grid assets beyond their planned operating conditions. This change will also reveal new potentials thro…

A Semi Centralized Training Decentralized Execution Architecture for Multi Agent Deep Reinforcement Learning in Traffic Signal Control

2025-12-04 · Arash Rezaali, Pouria Yazdani, Monireh Abdoos arxiv

Multi-agent reinforcement learning (MARL) has emerged as a promising paradigm for adaptive traffic signal control (ATSC) of multiple intersections. Existing approaches typically follow either a fully centralized or a ful…

Multi-agent Reinforcement Learning