Optimal Cycling of a Heterogenous Battery Bank via Reinforcement Learning
We consider the problem of optimal charging/discharging of a bank of heterogenous battery units, driven by stochastic electricity generation and demand processes. The batteries in the battery bank may differ with respect to their capacities, ramp constraints, losses, as well as cycling costs. The goal is to minimize the degradation costs associated with battery cycling in the long run; this is posed formally as a Markov decision process. We propose a linear function approximation based Q-learning algorithm for learning the optimal solution, using a specially designed class of kernel functions that approximate the structure of the value functions associated with the MDP. The proposed algorithm is validated via an extensive case study.
Code (0)
등록된 구현이 없습니다.
Tasks
Q-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Degradation-Aware Frequency Regulation of a Heterogeneous Battery Fleet via Reinforcement Learning
Battery energy storage systems are increasingly deployed as fast-responding resources for grid balancing services such as frequency regulation and for mitigating renewable generation uncertainty. However, repeated chargi…
Reinforcement LearningEmbedding Lithium-ion Battery Scrapping Criterion and Degradation Model in Optimal Operation of Peak-shaving Energy Storage
Lithium-ion battery systems have been used in practical power systems for peak-shaving, demand response, and frequency regulation. However, a lithium-ion battery is degrading while cycling and would be scrapped when the …
Planning low-carbon distributed power systems: Evaluating the role of energy storage
This paper introduces a mathematical formulation of energy storage systems into a generation capacity expansion framework to evaluate the role of energy storage in the decarbonization of distributed power systems. The mo…
Bayesian hierarchical modelling for battery lifetime early prediction
Accurate prediction of battery health is essential for real-world system management and lab-based experiment design. However, building a life-prediction model from different cycling conditions is still a challenge. Large…
ManagementPredictionAn Integrated System for WEEE Sorting Employing X-ray Imaging, AI-based Object Detection and Segmentation, and Delta Robot Manipulation
Battery recycling is becoming increasingly critical due to the rapid growth in battery usage and the limited availability of natural resources. Moreover, as battery energy densities continue to rise, improper handling du…
Image ReconstructionRobot ManipulationObject Detection