Surge Routing: Event-informed Multiagent Reinforcement Learning for Autonomous Rideshare

2023-07-05 · Daniel Garces, Stephanie Gil

Large events such as conferences, concerts and sports games, often cause surges in demand for ride services that are not captured in average demand patterns, posing unique challenges for routing algorithms. We propose a learning framework for an autonomous fleet of taxis that leverages event data from the internet to predict demand surges and generate cooperative routing policies. We achieve this through a combination of two major components: (i) a demand prediction framework that uses textual event information in the form of events' descriptions and reviews to predict event-driven demand surges over street intersections, and (ii) a scalable multiagent reinforcement learning framework that leverages demand predictions and uses one-agent-at-a-time rollout combined with limited sampling certainty equivalence to learn intersection-level routing policies. For our experimental results we consider real NYC ride share data for the year 2022 and information for more than 2000 events across 300 unique venues in Manhattan. We test our approach with a fleet of 100 taxis on a map with 2235 street intersections. Our experimental results demonstrate that our method learns routing policies that reduce wait time overhead per serviced request by 25% to 75%, while picking up 1% to 4% more requests than other model-based RL frameworks and classical methods in operations research.

📄 PDF Abstract BibTeX arXiv:2307.02637

Code (0)

등록된 구현이 없습니다.

Tasks

Model-based Reinforcement Learningreinforcement-learning Reinforcement Learning

MA-CDMR: An Intelligent Cross-domain Multicast Routing Method based on Multiagent Deep Reinforcement Learning in Multi-domain SDWN

2024-08-27 · Miao Ye, Hongwen Hu, Xiaoli Wang, Yuping Wang 외

The cross-domain multicast routing problem in a software-defined wireless network with multiple controllers is a classic NP-hard optimization problem. As the network size increases, designing and implementing cross-domai…

Deep Reinforcement Learning

Approximate Multiagent Reinforcement Learning for On-Demand Urban Mobility Problem on a Large Map (extended version)

2023-11-02 · Daniel Garces, Sushmita Bhattacharya, Dimitri Bertsekas, Stephanie Gil

In this paper, we focus on the autonomous multiagent taxi routing problem for a large urban environment where the location and number of future ride requests are unknown a-priori, but can be estimated by an empirical dis…

Towards Safe Control of Continuum Manipulator Using Shielded Multiagent Reinforcement Learning

2021-06-15 · Guanglin Ji, Junyan Yan, Jingxin Du, Wanquan Yan 외

Continuum robotic manipulators are increasingly adopted in minimal invasive surgery. However, their nonlinear behavior is challenging to model accurately, especially when subject to external interaction, potentially lead…

reinforcement-learning Reinforcement Learning (RL)

Cooperative Path Planning with Asynchronous Multiagent Reinforcement Learning

2024-09-01 · Jiaming Yin, Weixiong Rao, Yu Xiao, Keshuang Tang

In this paper, we study the shortest path problem (SPP) with multiple source-destination pairs (MSD), namely MSD-SPP, to minimize average travel time of all shortest paths. The inherent traffic capacity limits within a r…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Scaling Up Multiagent Reinforcement Learning for Robotic Systems: Learn an Adaptive Sparse Communication Graph

2020-03-02 · Chuangchuang Sun, Macheng Shen, Jonathan P. How

The complexity of multiagent reinforcement learning (MARL) in multiagent systems increases exponentially with respect to the agent number. This scalability issue prevents MARL from being applied in large-scale multiagent…

Reinforcement Learning Reinforcement Learning (RL)