UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Control
Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising performance in optimizing TSC, it is challenging to generalize these methods across intersections of different structures. In this work, a universal RL-based TSC framework is proposed for Vehicle-to-Everything (V2X) environments. The proposed framework introduces a novel agent design that incorporates a junction matrix to characterize intersection states, making the proposed model applicable to diverse intersections. To equip the proposed RL-based framework with enhanced capability of handling various intersection structures, novel traffic state augmentation methods are tailor-made for signal light control systems. Finally, extensive experimental results derived from multiple intersection configurations confirm the effectiveness of the proposed framework. The source code in this work is available at https://github.com/wmn7/Universal_Light
Code (1)
Tasks
reinforcement-learningReinforcement Learning (RL)Traffic Signal ControlSimilar Papers 제목 키워드 기반
ADLight: A Universal Approach of Traffic Signal Control with Augmented Data Using Reinforcement Learning
Traffic signal control has the potential to reduce congestion in dynamic networks. Recent studies show that traffic signal control with reinforcement learning (RL) methods can significantly reduce the average waiting tim…
Data Augmentationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Unicorn: A Universal and Collaborative Reinforcement Learning Approach Towards Generalizable Network-Wide Traffic Signal Control
Adaptive traffic signal control (ATSC) is crucial in reducing congestion, maximizing throughput, and improving mobility in rapidly growing urban areas. Recent advancements in parameter-sharing multi-agent reinforcement l…
Contrastive LearningMulti-agent Reinforcement LearningTraffic Signal ControlVariational InferenceAttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Control
We propose AttendLight, an end-to-end Reinforcement Learning (RL) algorithm for the problem of traffic signal control. Previous approaches for this problem have the shortcoming that they require training for each new int…
Decision Makingreinforcement-learningReinforcement Learning (RL)Traffic Signal ControlMulti-Agent Reinforcement Learning for Traffic Signal Control through Universal Communication Method
How to coordinate the communication among intersections effectively in real complex traffic scenarios with multi-intersection is challenging. Existing approaches only enable the communication in a heuristic manner withou…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Traffic Signal ControlBatch-Augmented Multi-Agent Reinforcement Learning for Efficient Traffic Signal Optimization
The goal of this work is to provide a viable solution based on reinforcement learning for traffic signal control problems. Although the state-of-the-art reinforcement learning approaches have yielded great success in a v…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1