Towards Robust Deep Reinforcement Learning for Traffic Signal Control: Demand Surges, Incidents and Sensor Failures

2019-04-17 · Filipe Rodrigues, Carlos Lima Azevedo

Reinforcement learning (RL) constitutes a promising solution for alleviating the problem of traffic congestion. In particular, deep RL algorithms have been shown to produce adaptive traffic signal controllers that outperform conventional systems. However, in order to be reliable in highly dynamic urban areas, such controllers need to be robust with the respect to a series of exogenous sources of uncertainty. In this paper, we develop an open-source callback-based framework for promoting the flexible evaluation of different deep RL configurations under a traffic simulation environment. With this framework, we investigate how deep RL-based adaptive traffic controllers perform under different scenarios, namely under demand surges caused by special events, capacity reductions from incidents and sensor failures. We extract several key insights for the development of robust deep RL algorithms for traffic control and propose concrete designs to mitigate the impact of the considered exogenous uncertainties.

📄 PDF Abstract BibTeX arXiv:1904.08353

Code (1)

fmpr/CAREL 공식 구현 tf

Tasks

Deep Reinforcement LearningReinforcement Learning Reinforcement Learning (RL)Traffic Signal Control

Adaptive Coordination Offsets for Signalized Arterial Intersections using Deep Reinforcement Learning

2020-08-06 · Keith Anshilo Diaz, Damian Dailisan, Umang Sharaf, Carissa Santos 외

Coordinating intersections in arterial networks is critical to the performance of urban transportation systems. Deep reinforcement learning (RL) has gained traction in traffic control research along with data-driven appr…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Feedback-feedforward Signal Control with Exogenous Demand Estimation in Congested Urban Road Networks

2023-12-12 · Leonardo Pedroso, Pedro Batista, Markos Papageorgiou

To cope with uncertain traffic patterns and traffic models, traffic-responsive signal control strategies in the literature are designed to be robust to these uncertainties. These robust strategies still require sensing i…

Traffic Signal Control

HiLight: A Hierarchical Reinforcement Learning Framework with Global Adversarial Guidance for Large-Scale Traffic Signal Control

2025-06-17 · Yaqiao Zhu, Hongkai Wen, Geyong Min, Man Luo

Efficient traffic signal control (TSC) is essential for mitigating urban congestion, yet existing reinforcement learning (RL) methods face challenges in scaling to large networks while maintaining global coordination. Ce…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Evaluating the Robustness of Reinforcement Learning based Adaptive Traffic Signal Control

2026-03-16 · Dickens Kwesiga, Angshuman Guin, Khaled Abdelghany, Michael Hunter arxiv

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, s…

Reinforcement Learning

A Novel Multi-Agent Deep RL Approach for Traffic Signal Control

2023-06-05 · Shijie Wang, Shangbo Wang

As travel demand increases and urban traffic condition becomes more complicated, applying multi-agent deep reinforcement learning (MARL) to traffic signal control becomes one of the hot topics. The rise of Reinforcement …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1