CoLight: Learning Network-level Cooperation for Traffic Signal Control
Cooperation among the traffic signals enables vehicles to move through intersections more quickly. Conventional transportation approaches implement cooperation by pre-calculating the offsets between two intersections. Such pre-calculated offsets are not suitable for dynamic traffic environments. To enable cooperation of traffic signals, in this paper, we propose a model, CoLight, which uses graph attentional networks to facilitate communication. Specifically, for a target intersection in a network, CoLight can not only incorporate the temporal and spatial influences of neighboring intersections to the target intersection, but also build up index-free modeling of neighboring intersections. To the best of our knowledge, we are the first to use graph attentional networks in the setting of reinforcement learning for traffic signal control and to conduct experiments on the large-scale road network with hundreds of traffic signals. In experiments, we demonstrate that by learning the communication, the proposed model can achieve superior performance against the state-of-the-art methods.
Code (4)
Tasks
Multi-agent Reinforcement LearningReinforcement LearningTraffic Signal ControlSimilar Papers 제목 키워드 기반
EcoLight: Intersection Control in Developing Regions Under Extreme Budget and Network Constraints
Effective intersection control can play an important role in reducing traffic congestion and associated vehicular emissions. This is vitally needed in developing countries, where air pollution is reaching life threatenin…
Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Generalized Phase Pressure Control Enhanced Reinforcement Learning for Traffic Signal Control
Appropriate traffic state representation is crucial for learning traffic signal control policies. However, most of the current traffic state representations are heuristically designed, with insufficient theoretical suppo…
Reinforcement Learning (RL)Traffic Signal ControlExpression might be enough: representing pressure and demand for reinforcement learning based traffic signal control
Many studies confirmed that a proper traffic state representation is more important than complex algorithms for the classical traffic signal control (TSC) problem. In this paper, we (1) present a novel, flexible and effi…
Reinforcement Learning (RL)Traffic Signal ControlDeep Reinforcement Learning-based Intelligent Traffic Signal Controls with Optimized CO2 emissions
Nowadays, transportation networks face the challenge of sub-optimal control policies that can have adverse effects on human health, the environment, and contribute to traffic congestion. Increased levels of air pollution…
Deep Reinforcement LearningQ-LearningPDLight: A Deep Reinforcement Learning Traffic Light Control Algorithm with Pressure and Dynamic Light Duration
Existing ineffective and inflexible traffic light control at urban intersections can often lead to congestion in traffic flows and cause numerous problems, such as long delay and waste of energy. How to find the optimal …
Deep Reinforcement LearningManagement