EMVLight: a Multi-agent Reinforcement Learning Framework for an Emergency Vehicle Decentralized Routing and Traffic Signal Control System

2022-06-27 · Haoran Su, Yaofeng D. Zhong, Joseph Y. J. Chow, Biswadip Dey, Li Jin

Emergency vehicles (EMVs) play a crucial role in responding to time-critical calls such as medical emergencies and fire outbreaks in urban areas. Existing methods for EMV dispatch typically optimize routes based on historical traffic-flow data and design traffic signal pre-emption accordingly; however, we still lack a systematic methodology to address the coupling between EMV routing and traffic signal control. In this paper, we propose EMVLight, a decentralized reinforcement learning (RL) framework for joint dynamic EMV routing and traffic signal pre-emption. We adopt the multi-agent advantage actor-critic method with policy sharing and spatial discounted factor. This framework addresses the coupling between EMV navigation and traffic signal control via an innovative design of multi-class RL agents and a novel pressure-based reward function. The proposed methodology enables EMVLight to learn network-level cooperative traffic signal phasing strategies that not only reduce EMV travel time but also shortens the travel time of non-EMVs. Simulation-based experiments indicate that EMVLight enables up to a $42.6\%$ reduction in EMV travel time as well as an $23.5\%$ shorter average travel time compared with existing approaches.

📄 PDF Abstract BibTeX arXiv:2206.13441

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning Reinforcement Learning (RL)Traffic Signal Control

Methods 이 논문이 사용한 방법론

Travel 설명 없음

EMVLight: A Decentralized Reinforcement Learning Framework for Efficient Passage of Emergency Vehicles

2021-09-12 · Haoran Su, Yaofeng Desmond Zhong, Biswadip Dey, Amit Chakraborty

Emergency vehicles (EMVs) play a crucial role in responding to time-critical events such as medical emergencies and fire outbreaks in an urban area. The less time EMVs spend traveling through the traffic, the more likely…

reinforcement-learning Reinforcement Learning (RL)Traffic Signal Control

A Decentralized Reinforcement Learning Framework for Efficient Passage of Emergency Vehicles

2021-10-30 · Haoran Su, Yaofeng Desmond Zhong, Biswadip Dey, Amit Chakraborty

Emergency vehicles (EMVs) play a critical role in a city's response to time-critical events such as medical emergencies and fire outbreaks. The existing approaches to reduce EMV travel time employ route optimization and …

reinforcement-learning Reinforcement Learning (RL)Traffic Signal Control

Facilitating Emergency Vehicle Passage in Congested Urban Areas Using Multi-agent Deep Reinforcement Learning

2025-02-23 · Haoran Su

Emergency Response Time (ERT) is crucial for urban safety, measuring cities' ability to handle medical, fire, and crime emergencies. In NYC, medical ERT increased 72% from 7.89 minutes in 2014 to 14.27 minutes in 2024, w…

Deep Reinforcement Learning Multi-agent Reinforcement Learning

Intersection-Aware Assessment of EMS Accessibility in NYC: A Data-Driven Approach

2024-12-05 · Haoran Su, Joseph Y. J. Chow

Emergency response times are critical in densely populated urban environments like New York City (NYC), where traffic congestion significantly impedes emergency vehicle (EMV) mobility. This study introduces an intersecti…

Multi-agent Reinforcement Learning Traffic Signal Control

Hierarchical GNN-Based Multi-Agent Learning for Dynamic Queue-Jump Lane and Emergency Vehicle Corridor Formation

2026-01-07 · Haoran Su arxiv

Emergency vehicles require rapid passage through congested traffic, yet existing strategies fail to adapt to dynamic conditions. We propose a novel hierarchical graph neural network (GNN)-based multi-agent reinforcement …

Multi-agent Reinforcement Learning Graph Neural Network