Enhancing Traffic Signal Control through Model-based Reinforcement Learning and Policy Reuse

2025-03-11 · Yihong Li, Chengwei Zhang, Furui Zhan, Wanting Liu, Kailing Zhou, Longji Zheng

Multi-agent reinforcement learning (MARL) has shown significant potential in traffic signal control (TSC). However, current MARL-based methods often suffer from insufficient generalization due to the fixed traffic patterns and road network conditions used during training. This limitation results in poor adaptability to new traffic scenarios, leading to high retraining costs and complex deployment. To address this challenge, we propose two algorithms: PLight and PRLight. PLight employs a model-based reinforcement learning approach, pretraining control policies and environment models using predefined source-domain traffic scenarios. The environment model predicts the state transitions, which facilitates the comparison of environmental features. PRLight further enhances adaptability by adaptively selecting pre-trained PLight agents based on the similarity between the source and target domains to accelerate the learning process in the target domain. We evaluated the algorithms through two transfer settings: (1) adaptability to different traffic scenarios within the same road network, and (2) generalization across different road networks. The results show that PRLight significantly reduces the adaptation time compared to learning from scratch in new TSC scenarios, achieving optimal performance using similarities between available and target scenarios.

📄 PDF Abstract BibTeX arXiv:2503.08728

Code (0)

등록된 구현이 없습니다.

Tasks

Model-based Reinforcement LearningMulti-agent Reinforcement Learning reinforcement-learning Reinforcement LearningTraffic Signal Control

MoveLight: Enhancing Traffic Signal Control through Movement-Centric Deep Reinforcement Learning

2024-07-24 · Junqi Shao, Chenhao Zheng, Yuxuan Chen, YuCheng Huang 외

This paper introduces MoveLight, a novel traffic signal control system that enhances urban traffic management through movement-centric deep reinforcement learning. By leveraging detailed real-time data and advanced machi…

Deep Reinforcement Learning Management reinforcement-learning Reinforcement Learning+1

Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning

2021-04-20 · Zhenning Li, Hao Yu, Guohui Zhang, Shangjia Dong 외

Inefficient traffic control may cause numerous problems such as traffic congestion and energy waste. This paper proposes a novel multi-agent reinforcement learning method, named KS-DDPG (Knowledge Sharing Deep Determinis…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Mitigating Partial Observability in Adaptive Traffic Signal Control with Transformers

2024-09-16 · Xiaoyu Wang, Ayal Taitler, Scott Sanner, Baher Abdulhai

Efficient traffic signal control is essential for managing urban transportation, minimizing congestion, and improving safety and sustainability. Reinforcement Learning (RL) has emerged as a promising approach to enhancin…

Management Reinforcement Learning (RL)Traffic Signal Control

Joint Optimization of Traffic Signal Control and Vehicle Routing in Signalized Road Networks using Multi-Agent Deep Reinforcement Learning

2023-10-16 · Xianyue Peng, Hang Gao, Gengyue Han, Hao Wang 외

Urban traffic congestion is a critical predicament that plagues modern road networks. To alleviate this issue and enhance traffic efficiency, traffic signal control and vehicle routing have proven to be effective measure…

Deep Reinforcement Learning Traffic Signal Control

Random Ensemble Reinforcement Learning for Traffic Signal Control

2022-03-10 · Ruijie Qi, Jianbin Huang, He Li, Qinglin Tan 외

Traffic signal control is a significant part of the construction of intelligent transportation. An efficient traffic signal control strategy can reduce traffic congestion, improve urban road traffic efficiency and facili…

Ensemble Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1