Real-Time Network-Level Traffic Signal Control: An Explicit Multiagent Coordination Method
Efficient traffic signal control (TSC) has been one of the most useful ways for reducing urban road congestion. Key to the challenge of TSC includes 1) the essential of real-time signal decision, 2) the complexity in traffic dynamics, and 3) the network-level coordination. Recent efforts that applied reinforcement learning (RL) methods can query policies by mapping the traffic state to the signal decision in real-time, however, is inadequate for unexpected traffic flows. By observing real traffic information, online planning methods can compute the signal decisions in a responsive manner. We propose an explicit multiagent coordination (EMC)-based online planning methods that can satisfy adaptive, real-time and network-level TSC. By multiagent, we model each intersection as an autonomous agent, and the coordination efficiency is modeled by a cost (i.e., congestion index) function between neighbor intersections. By network-level coordination, each agent exchanges messages with respect to cost function with its neighbors in a fully decentralized manner. By real-time, the message passing procedure can interrupt at any time when the real time limit is reached and agents select the optimal signal decisions according to the current message. Moreover, we prove our EMC method can guarantee network stability by borrowing ideas from transportation domain. Finally, we test our EMC method in both synthetic and real road network datasets. Experimental results are encouraging: compared to RL and conventional transportation baselines, our EMC method performs reasonably well in terms of adapting to real-time traffic dynamics, minimizing vehicle travel time and scalability to city-scale road networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement Learning (RL)Traffic Signal ControlMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MoveLight: Enhancing Traffic Signal Control through Movement-Centric Deep Reinforcement Learning
This paper introduces MoveLight, a novel traffic signal control system that enhances urban traffic management through movement-centric deep reinforcement learning. By leveraging detailed real-time data and advanced machi…
Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning+1TuSeRACT: Turn-Sample-Based Real-Time Traffic Signal Control
Real-time traffic signal control is a challenging problem owing to constantly changing traffic demand patterns, limited planning time and various sources of uncertainty (e.g., turn movements, vehicle detection) in the re…
SchedulingTraffic Signal Controlvehicle detectionEMVLight: A Decentralized Reinforcement Learning Framework for Efficient Passage of Emergency Vehicles
Emergency vehicles (EMVs) play a crucial role in responding to time-critical events such as medical emergencies and fire outbreaks in an urban area. The less time EMVs spend traveling through the traffic, the more likely…
reinforcement-learningReinforcement Learning (RL)Traffic Signal ControlReal-Time Traffic Signal Control for Modern Roundabouts by Using Particle Swarm Optimization-Based Fuzzy Controller
Due to that the existing traffic facilities can hardly be extended, developing traffic signal control methods is the most important way to improve the traffic efficiency of modern roundabouts. This paper proposes a novel…
Traffic Signal ControlUnsignalized Intersection Management Strategy for Mixed Autonomy Traffic Streams
With the rapid development of connected and automated vehicles (CAVs) and intelligent transportation infrastructure, CAVs, connected human-driven vehicles (CHVs), and un-connected human-driven vehicles (HVs) will coexist…
Decision MakingManagement