Deep Reinforcement Learning-Based Optimization of Second-Life Battery Utilization in Electric Vehicles Charging Stations
The rapid rise in electric vehicle (EV) adoption presents significant challenges in managing the vast number of retired EV batteries. Research indicates that second-life batteries (SLBs) from EVs typically retain considerable residual capacity, offering extended utility. These batteries can be effectively repurposed for use in EV charging stations (EVCS), providing a cost-effective alternative to new batteries and reducing overall planning costs. Integrating battery energy storage systems (BESS) with SLBs into EVCS is a promising strategy to alleviate system overload. However, efficient operation of EVCS with integrated BESS is hindered by uncertainties such as fluctuating EV arrival and departure times and variable power prices from the grid. This paper presents a deep reinforcement learning-based (DRL) planning framework for EV charging stations with BESS, leveraging SLBs. We employ the advanced soft actor-critic (SAC) approach, training the model on a year's worth of data to account for seasonal variations, including weekdays and holidays. A tailored reward function enables effective offline training, allowing real-time optimization of EVCS operations under uncertainty.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningSimilar Papers 제목 키워드 기반
Economic Optimal Power Management of Second-Life Battery Energy Storage Systems
Second-life battery energy storage systems (SL-BESS) are an economical means of long-duration grid energy storage. They utilize retired battery packs from electric vehicles to store and provide electrical energy at the u…
ManagementBatteryLife: A Comprehensive Dataset and Benchmark for Battery Life Prediction
Battery Life Prediction (BLP), which relies on time series data produced by battery degradation tests, is crucial for battery utilization, optimization, and production. Despite impressive advancements, this research area…
BenchmarkingTime SeriesOptimal Charging Method for Effective Li-ion Battery Life Extension Based on Reinforcement Learning
A reinforcement learning-based optimal charging strategy is proposed for Li-ion batteries to extend the battery life and to ensure the end-user convenience. Unlike most previous studies that do not reflect real-world sce…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Optimal Utilization Strategy of the LiFePO$_4$ Battery Storage
The paper provides a comprehensive battery storage modelling approach, which accounts for operation- and degradation-aware characteristics, i.e., variable efficiency, internal resistance growth, and capacity fade. Based …
SchedulingA Deep Reinforcement Learning Approach to Battery Management in Dairy Farming via Proximal Policy Optimization
Dairy farms consume a significant amount of electricity for their operations, and this research focuses on enhancing energy efficiency and minimizing the impact on the environment in the sector by maximizing the utilizat…
Deep Reinforcement Learningenergy managementManagementQ-Learning+2