Scalable Adaptive Traffic Light Control Over a Traffic Network Including Transit Delays
We study the Traffic Light Control (TLC) problem for a traffic network with multiple intersections in an artery, including the effect of transit delays for vehicles moving from one intersection to the next. The goal is to minimize the overall mean waiting time and improve the ``green wave'' properties in such systems. Using a stochastic hybrid system model with parametric traffic light controllers, we use Infinitesimal Perturbation Analysis (IPA) to derive a data-driven cost gradient estimator with respect to these parameters. We then iteratively adjust them through an online gradient-based algorithm. We show that the event-driven nature of the IPA estimators driving the controllers leads to scalable computationally efficient controllers as the dimensionality of the traffic network increases.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Scalable Adaptive Traffic Light Control Over a Traffic Network Including Turns, Transit Delays, and Blocking
We develop adaptive data-driven traffic light controllers for a grid-like traffic network considering straight, left-turn, and right-turn traffic flows. The analysis incorporates transit delays and blocking effects on ve…
BlockingSocialLight: Distributed Cooperation Learning towards Network-Wide Traffic Signal Control
Many recent works have turned to multi-agent reinforcement learning (MARL) for adaptive traffic signal control to optimize the travel time of vehicles over large urban networks. However, achieving effective and scalable …
counterfactualCounterfactual ReasoningMulti-agent Reinforcement LearningTraffic Signal ControlCoordLight: Learning Decentralized Coordination for Network-Wide Traffic Signal Control
Adaptive traffic signal control (ATSC) is crucial in alleviating congestion, maximizing throughput and promoting sustainable mobility in ever-expanding cities. Multi-Agent Reinforcement Learning (MARL) has recently shown…
Multi-agent Reinforcement LearningScalable Multi-Objective Optimization for Robust Traffic Signal Control in Uncertain Environments
Intelligent traffic signal control is essential to modern urban management, with important impacts on economic efficiency, environmental sustainability, and quality of daily life. However, in current decades, it continue…
Traffic Signal ControlUnicorn: A Universal and Collaborative Reinforcement Learning Approach Towards Generalizable Network-Wide Traffic Signal Control
Adaptive traffic signal control (ATSC) is crucial in reducing congestion, maximizing throughput, and improving mobility in rapidly growing urban areas. Recent advancements in parameter-sharing multi-agent reinforcement l…
Contrastive LearningMulti-agent Reinforcement LearningTraffic Signal ControlVariational Inference