Adaptive Safe Reinforcement Learning-Enabled Optimization of Battery Fast-Charging Protocols
Optimizing charging protocols is critical for reducing battery charging time and decelerating battery degradation in applications such as electric vehicles. Recently, reinforcement learning (RL) methods have been adopted for such purposes. However, RL-based methods may not ensure system (safety) constraints, which can cause irreversible damages to batteries and reduce their lifetime. To this end, this work proposes an adaptive and safe RL framework to optimize fast charging strategies while respecting safety constraints with a high probability. In our method, any unsafe action that the RL agent decides will be projected into a safety region by solving a constrained optimization problem. The safety region is constructed using adaptive Gaussian process (GP) models, consisting of static and dynamic GPs, that learn from online experience to adaptively account for any changes in battery dynamics. Simulation results show that our method can charge the batteries rapidly with constraint satisfaction under varying operating conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement Learning (RL)Safe Reinforcement LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Data-Enabled Predictive Control for Fast Charging of Lithium-Ion Batteries with Constraint Handling
Fast charging of lithium-ion batteries has gained extensive research interests, but most of existing methods are either based on simple rule-based charging profiles or require explicit battery models that are non-trivial…
Balancing SoC in Battery Cells using Safe Action Perturbations
Managing equal charge levels in active cell balancing while charging a Li-ion battery is challenging. An imbalance in charge levels affects the state of health of the battery, along with the concerns of thermal runaway a…
Deep Reinforcement LearningReinforcement Learning (RL)Safety-Driven Battery Charging: A Fisher Information-guided Adaptive MPC with Real-time Parameter Identification
Lithium-ion (Li-ion) batteries are ubiquitous in modern energy storage systems, highlighting the critical need to comprehend and optimize their performance. Yet, battery models often exhibit poor parameter identifiabilit…
ManagementModel Predictive Controlparameter estimationAdaptive BESS and Grid Setpoints Optimization: A Model-Free Framework for Efficient Battery Management under Dynamic Tariff Pricing
This paper introduces an enhanced framework for managing Battery Energy Storage Systems (BESS) in residential communities. The non-convex BESS control problem is first addressed using a gradient-based optimizer, providin…
Deep Reinforcement LearningManagementA fast balance optimization approach for charging enhancement of lithium-ion battery packs through deep reinforcement learning
This paper presents an innovative strategy that utilizes reinforcement learning to enhance the fast balance charging of lithium-ion battery packs. We develop an interactive framework for lithium-ion batteries by utilizin…
Deep Reinforcement Learningenergy managementMultiobjective OptimizationReinforcement Learning (RL)