Reinforcement Learning for Battery Energy Storage Dispatch augmented with Model-based Optimizer
Reinforcement learning has been found useful in solving optimal power flow (OPF) problems in electric power distribution systems. However, the use of largely model-free reinforcement learning algorithms that completely ignore the physics-based modeling of the power grid compromises the optimizer performance and poses scalability challenges. This paper proposes a novel approach to synergistically combine the physics-based models with learning-based algorithms using imitation learning to solve distribution-level OPF problems. Specifically, we propose imitation learning based improvements in deep reinforcement learning (DRL) methods to solve the OPF problem for a specific case of battery storage dispatch in the power distribution systems. The proposed imitation learning algorithm uses the approximate optimal solutions obtained from a linearized model-based OPF solver to provide a good initial policy for the DRL algorithms while improving the training efficiency. The effectiveness of the proposed approach is demonstrated using IEEE 34-bus and 123-bus distribution feeders with numerous distribution-level battery storage systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningImitation Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Linear Aggregate Model for Realizable Dispatch of Homogeneous Energy Storage
To optimize the dispatch of batteries, a model is required that can predict the state of energy (SOE) trajectory for a chosen open-loop power schedule to ensure admissibility (i.e., that schedule can be realized). Howeve…
Stochastic Operation of Energy Constrained Microgrids Considering Battery Degradation
Power systems with high penetration of variable renewable generation are vulnerable to periods with low generation. An alternative to retain high dispatchable generation capacity is electric energy storage that enables u…
energy managementManagementA Dynamic Analysis of Energy Storage with Renewable and Diesel Generation using Volterra Equations
Energy storage systems will play a key role in the power system of the twenty first century considering the large penetrations of variable renewable energy, growth in transport electrification and decentralisation of hea…
A comparison between central- and self-dispatch storage management principles in island systems
This paper presents a comparative evaluation of central and self-dispatch management concepts for battery energy storage (BES) facilities in island power systems with a high renewable energy source (RES) penetration. BES…
ManagementAccounting for Optimal Control in the Sizing of Isolated Hybrid Renewable Energy Systems Using Imitation Learning
Decarbonization of isolated or off-grid energy systems through phase-in of large shares of intermittent solar or wind generation requires co-installation of energy storage or continued use of existing fossil dispatchable…