AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Control
We propose AttendLight, an end-to-end Reinforcement Learning (RL) algorithm for the problem of traffic signal control. Previous approaches for this problem have the shortcoming that they require training for each new intersection with a different structure or traffic flow distribution. AttendLight solves this issue by training a single, universal model for intersections with any number of roads, lanes, phases (possible signals), and traffic flow. To this end, we propose a deep RL model which incorporates two attention models. The first attention model is introduced to handle different numbers of roads-lanes; and the second attention model is intended for enabling decision-making with any number of phases in an intersection. As a result, our proposed model works for any intersection configuration, as long as a similar configuration is represented in the training set. Experiments were conducted with both synthetic and real-world standard benchmark data-sets. The results we show cover intersections with three or four approaching roads; one-directional/bi-directional roads with one, two, and three lanes; different number of phases; and different traffic flows. We consider two regimes: (i) single-environment training, single-deployment, and (ii) multi-environment training, multi-deployment. AttendLight outperforms both classical and other RL-based approaches on all cases in both regimes.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision Makingreinforcement-learningReinforcement Learning (RL)Traffic Signal ControlSimilar Papers 제목 키워드 기반
UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Control
Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising …
reinforcement-learningReinforcement Learning (RL)Traffic Signal ControlADLight: A Universal Approach of Traffic Signal Control with Augmented Data Using Reinforcement Learning
Traffic signal control has the potential to reduce congestion in dynamic networks. Recent studies show that traffic signal control with reinforcement learning (RL) methods can significantly reduce the average waiting tim…
Data Augmentationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Multi-Agent Reinforcement Learning for Traffic Signal Control through Universal Communication Method
How to coordinate the communication among intersections effectively in real complex traffic scenarios with multi-intersection is challenging. Existing approaches only enable the communication in a heuristic manner withou…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Traffic Signal ControlUnicorn: A Universal and Collaborative Reinforcement Learning Approach Towards Generalizable Network-Wide Traffic Signal Control
Adaptive traffic signal control (ATSC) is crucial in reducing congestion, maximizing throughput, and improving mobility in rapidly growing urban areas. Recent advancements in parameter-sharing multi-agent reinforcement l…
Contrastive LearningMulti-agent Reinforcement LearningTraffic Signal ControlVariational InferenceCourteous Behavior of Automated Vehicles at Unsignalized Intersections via Reinforcement Learning
The transition from today's mostly human-driven traffic to a purely automated one will be a gradual evolution, with the effect that we will likely experience mixed traffic in the near future. Connected and automated vehi…
Autonomous VehiclesCollision AvoidanceDeep Reinforcement LearningManagement+3