Coordinated Charging Station Search in Stochastic Environments: A Multi-Agent Approach
Range and charge anxiety remain essential barriers to a faster electric vehicle market diffusion. To this end, quickly and reliably finding suitable charging stations may foster an electric vehicle uptake by mitigating drivers' anxieties. Here, existing commercial services help drivers to find available stations based on real-time availability data but struggle with data inaccuracy, e.g., due to conventional vehicles blocking the access to public charging stations. In this context, recent works have studied stochastic search methods to account for availability uncertainty in order to minimize a driver's detour until reaching an available charging station. So far, both practical and theoretical approaches ignore driver coordination enabled by charging requests centralization or sharing of data, e.g., sharing observations of charging stations' availability or visit intentions between drivers. Against this background, we study coordinated stochastic search algorithms, which help to reduce station visit conflicts and improve the drivers' charging experience. We model a multi-agent stochastic charging station search problem as a finite-horizon Markov decision process and introduce an online solution framework applicable to static and dynamic policies. In contrast to static policies, dynamic policies account for information updates during policy planning and execution. We present a hierarchical implementation of a single-agent heuristic for decentralized decision making and a rollout algorithm for centralized decision making. Extensive numerical studies show that compared to an uncoordinated setting, a decentralized setting with visit-intentions sharing decreases the system cost by 26%, which is nearly as good as the 28% cost decrease achieved in a centralized setting, and saves up to 23% of a driver's search time while increasing her search reliability.
Code (0)
등록된 구현이 없습니다.
Tasks
BlockingDecision MakingSimilar Papers 제목 키워드 기반
Deep Reinforcement Learning for Dynamic Battery Management of Autonomous Order Pickers
Battery charging of Autonomous Mobile Robots (AMRs) in warehouses is a critical operational challenge that heavily impacts both order processing times and throughput. In this study, we address the dynamic AMR charging pr…
Reinforcement LearningPRO-SPECT: Probabilistically Safe Scalable Planning for Energy-Aware Coordinated UAV-UGV Teams in Stochastic Environments
We consider energy-aware planning for an unmanned aerial vehicle (UAV) and unmanned ground vehicle (UGV) team operating in a stochastic environment. The UAV must visit a set of air points in minimum time while respecting…
Coordinated Expansion Planning of Transmission and Distribution Systems Integrated with Smart Grid Technologies
Integration of smart grid technologies in distribution systems, particularly behind-the-meter initiatives, has a direct impact on transmission network planning. This paper develops a coordinated expansion planning of tra…
Multi-objective Scheduling of Electric Vehicle Charging/Discharging with Time of Use Tariff
The increased uptake of electric vehicles (EVs) leads to increased demand for electricity, and sometimes pressure on power grids. Uncoordinated charging of EVs may result in stress on distribution networks, and often som…
SchedulingCoordinated Planning of Offshore Charging Stations and Electrified Ships: A Case Study on Shanghai-Busan Maritime Route
Despite the success of electric vehicles on land, electrification of maritime ships is challenged by the dilemma of range anxiety and cargo-carrying capacity. The longer range requires larger batteries, which inevitably …