paper-with-me

홈 › Papers

Optimal Cycling of a Heterogenous Battery Bank via Reinforcement Learning

2021-09-15 · Vivek Deulkar, Jayakrishnan Nair

We consider the problem of optimal charging/discharging of a bank of heterogenous battery units, driven by stochastic electricity generation and demand processes. The batteries in the battery bank may differ with respect to their capacities, ramp constraints, losses, as well as cycling costs. The goal is to minimize the degradation costs associated with battery cycling in the long run; this is posed formally as a Markov decision process. We propose a linear function approximation based Q-learning algorithm for learning the optimal solution, using a specially designed class of kernel functions that approximate the structure of the value functions associated with the MDP. The proposed algorithm is validated via an extensive case study.

📄 PDF Abstract BibTeX arXiv:2109.07137

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Degradation-Aware Frequency Regulation of a Heterogeneous Battery Fleet via Reinforcement Learning

2026-01-30 · Tanay Raghunandan Srinivasa, Vivek Deulkar, Jia Bhargava, Mohammad Hajiesmaili 외 arxiv

Battery energy storage systems are increasingly deployed as fast-responding resources for grid balancing services such as frequency regulation and for mitigating renewable generation uncertainty. However, repeated chargi…

Reinforcement Learning

Embedding Lithium-ion Battery Scrapping Criterion and Degradation Model in Optimal Operation of Peak-shaving Energy Storage

2019-10-04 · Qingchun Hou, Yanghao Yu, Ershun Du, Hongjie He 외

Lithium-ion battery systems have been used in practical power systems for peak-shaving, demand response, and frequency regulation. However, a lithium-ion battery is degrading while cycling and would be scrapped when the …

Planning low-carbon distributed power systems: Evaluating the role of energy storage

2020-09-20 · Jiachen Mao, Mehdi Jafari, Audun Botterud

This paper introduces a mathematical formulation of energy storage systems into a generation capacity expansion framework to evaluate the role of energy storage in the decarbonization of distributed power systems. The mo…

Bayesian hierarchical modelling for battery lifetime early prediction

2022-11-10 · ZiHao Zhou, David A. Howey

Accurate prediction of battery health is essential for real-world system management and lab-based experiment design. However, building a life-prediction model from different cycling conditions is still a challenge. Large…

ManagementPrediction

An Integrated System for WEEE Sorting Employing X-ray Imaging, AI-based Object Detection and Segmentation, and Delta Robot Manipulation

2025-12-05 · Panagiotis Giannikos, Lampis Papakostas, Evangelos Katralis, Panagiotis Mavridis 외 arxiv

Battery recycling is becoming increasingly critical due to the rapid growth in battery usage and the limited availability of natural resources. Moreover, as battery energy densities continue to rise, improper handling du…

Image ReconstructionRobot ManipulationObject Detection