Safety-Aware Reinforcement Learning for Electric Vehicle Charging Station Management in Distribution Network
The increasing integration of electric vehicles (EVs) into the grid can pose a significant risk to the distribution system operation in the absence of coordination. In response to the need for effective coordination of EVs within the distribution network, this paper presents a safety-aware reinforcement learning (RL) algorithm designed to manage EV charging stations while ensuring the satisfaction of system constraints. Unlike existing methods, our proposed algorithm does not rely on explicit penalties for constraint violations, eliminating the need for penalty coefficient tuning. Furthermore, managing EV charging stations is further complicated by multiple uncertainties, notably the variability in solar energy generation and energy prices. To address this challenge, we develop an off-policy RL algorithm to efficiently utilize data to learn patterns in such uncertain environments. Our algorithm also incorporates a maximum entropy framework to enhance the RL algorithm's exploratory process, preventing convergence to local optimal solutions. Simulation results demonstrate that our algorithm outperforms traditional RL algorithms in managing EV charging in the distribution network.
Code (0)
등록된 구현이 없습니다.
Tasks
ManagementReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Advancements in Electric Vehicle Charging Optimization: A Survey of Reinforcement Learning Approaches
In response to global warming and energy shortages, there has been a significant shift towards integrating renewable energy sources, energy storage systems, and electric vehicles. Deploying electric vehicles within smart…
reinforcement-learningReinforcement LearningOut-of-Distribution-Aware Electric Vehicle Charging
We tackle the challenge of learning to charge Electric Vehicles (EVs) with Out-of-Distribution (OOD) data. Traditional scheduling algorithms typically fail to balance near-optimal average performance with worst-case guar…
Model Predictive Controlreinforcement-learningReinforcement Learning (RL)SchedulingAdaptive Safe Reinforcement Learning-Enabled Optimization of Battery Fast-Charging Protocols
Optimizing charging protocols is critical for reducing battery charging time and decelerating battery degradation in applications such as electric vehicles. Recently, reinforcement learning (RL) methods have been adopted…
Reinforcement Learning (RL)Safe Reinforcement LearningOptimal Placement of Public Electric Vehicle Charging Stations Using Deep Reinforcement Learning
The placement of charging stations in areas with developing charging infrastructure is a critical component of the future success of electric vehicles (EVs). In Albany County in New York, the expected rise in the EV popu…
Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Learning to Operate an Electric Vehicle Charging Station Considering Vehicle-grid Integration
The rapid adoption of electric vehicles (EVs) calls for the widespread installation of EV charging stations. To maximize the profitability of charging stations, intelligent controllers that provide both charging and elec…
Model Predictive Controlreinforcement-learningReinforcement LearningReinforcement Learning (RL)