Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control

2022-10-04 · Zixuan Zhang, Yuning Jiang, Yuanming Shi, Ye Shi, Wei Chen

With the recent advances in mobile energy storage technologies, electric vehicles (EVs) have become a crucial part of smart grids. When EVs participate in the demand response program, the charging cost can be significantly reduced by taking full advantage of the real-time pricing signals. However, many stochastic factors exist in the dynamic environment, bringing significant challenges to design an optimal charging/discharging control strategy. This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments to maximize EV users' benefits. We first formulate this problem as a Markov decision process (MDP). Then we consider EV users with different behaviors as agents in different environments. Furthermore, a horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. This approach can learn an optimal charging/discharging control strategy without sharing users' profiles. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various stochastic factors.

📄 PDF Abstract BibTeX arXiv:2210.01452

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning (RL)

Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks

2023-08-17 · Junkai Qian, Yuning Jiang, Xin Liu, Qing Wang 외

With the growing popularity of electric vehicles (EVs), maintaining power grid stability has become a significant challenge. To address this issue, EV charging control strategies have been developed to manage the switch …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Advancements in Electric Vehicle Charging Optimization: A Survey of Reinforcement Learning Approaches

2024-10-21 · Mehrshad Shokati, Parisa Mohammadi, Atoosa Amirinian

In response to global warming and energy shortages, there has been a significant shift towards integrating renewable energy sources, energy storage systems, and electric vehicles. Deploying electric vehicles within smart…

reinforcement-learning Reinforcement Learning

An Energy Consumption Model for Electrical Vehicle Networks via Extended Federated-learning

2021-11-13 · Shiliang Zhang

Electrical vehicle (EV) raises to promote an eco-sustainable society. Nevertheless, the "range anxiety" of EV hinders its wider acceptance among customers. This paper proposes a novel solution to range anxiety based on a…

Anomaly Detection Federated Learning

Fractional Order Federated Learning for Battery Electric Vehicle Energy Consumption Modeling

2026-02-13 · Mohammad Partohaghighi, Roummel Marcia, Bruce J. West, YangQuan Chen arxiv

Federated learning on connected electric vehicles (BEVs) faces severe instability due to intermittent connectivity, time-varying client participation, and pronounced client-to-client variation induced by diverse operatin…

Federated Learning

Privacy-Aware Energy Consumption Modeling of Connected Battery Electric Vehicles using Federated Learning

2023-12-12 · Sen Yan, Hongyuan Fang, Ji Li, Tomas Ward 외

Battery Electric Vehicles (BEVs) are increasingly significant in modern cities due to their potential to reduce air pollution. Precise and real-time estimation of energy consumption for them is imperative for effective i…