Reward Design for Driver Repositioning Using Multi-Agent Reinforcement Learning
A large portion of passenger requests is reportedly unserviced, partially due to vacant for-hire drivers' cruising behavior during the passenger seeking process. This paper aims to model the multi-driver repositioning task through a mean field multi-agent reinforcement learning (MARL) approach that captures competition among multiple agents. Because the direct application of MARL to the multi-driver system under a given reward mechanism will likely yield a suboptimal equilibrium due to the selfishness of drivers, this study proposes a reward design scheme with which a more desired equilibrium can be reached. To effectively solve the bilevel optimization problem with upper level as the reward design and the lower level as a multi-agent system, a Bayesian optimization (BO) algorithm is adopted to speed up the learning process. We then apply the bilevel optimization model to two case studies, namely, e-hailing driver repositioning under service charge and multiclass taxi driver repositioning under NYC congestion pricing. In the first case study, the model is validated by the agreement between the derived optimal control from BO and that from an analytical solution. With a simple piecewise linear service charge, the objective of the e-hailing platform can be increased by 8.4%. In the second case study, an optimal toll charge of $5.1 is solved using BO, which improves the objective of city planners by 7.9%, compared to that without any toll charge. Under this optimal toll charge, the number of taxis in the NYC central business district is decreased, indicating a better traffic condition, without substantially increasing the crowdedness of the subway system.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationBilevel OptimizationMulti-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Reinforcement Learning for Multi-Driver Vehicle Dispatching and Repositioning Problem
Order dispatching and driver repositioning (also known as fleet management) in the face of spatially and temporally varying supply and demand are central to a ride-sharing platform marketplace. Hand-crafting heuristic so…
BIG-bench Machine LearningDecision MakingDeep Reinforcement LearningManagement+3LLM-ODDR: A Large Language Model Framework for Joint Order Dispatching and Driver Repositioning
Ride-hailing platforms face significant challenges in optimizing order dispatching and driver repositioning operations in dynamic urban environments. Traditional approaches based on combinatorial optimization, rule-based…
Combinatorial OptimizationFairnessLanguage ModelingLanguage Modelling+1Vehicle Rebalancing Under Adherence Uncertainty
Ride hailing systems suffer from spatial-temporal supply demand imbalance due to drivers operating in independent, and uncoordinated manner. Several fleet rebalancing models have been proposed that can provide reposition…
Real-world Ride-hailing Vehicle Repositioning using Deep Reinforcement Learning
We present a new practical framework based on deep reinforcement learning and decision-time planning for real-world vehicle repositioning on ride-hailing (a type of mobility-on-demand, MoD) platforms. Our approach learns…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)i-Rebalance: Personalized Vehicle Repositioning for Supply Demand Balance
Ride-hailing platforms have been facing the challenge of balancing demand and supply. Existing vehicle reposition techniques often treat drivers as homogeneous agents and relocate them deterministically, assuming complia…
Deep Reinforcement Learning