Optimizing Traffic Signal Control using High-Dimensional State Representation and Efficient Deep Reinforcement Learning
In reinforcement learning-based (RL-based) traffic signal control (TSC), decisions on the signal timing are made based on the available information on vehicles at a road intersection. This forms the state representation for the RL environment which can either be high-dimensional containing several variables or a low-dimensional vector. Current studies suggest that using high dimensional state representations does not lead to improved performance on TSC. However, we argue, with experimental results, that the use of high dimensional state representations can, in fact, lead to improved TSC performance with improvements up to 17.9% of the average waiting time. This high-dimensional representation is obtainable using the cost-effective vehicle-to-infrastructure (V2I) communication, encouraging its adoption for TSC. Additionally, given the large size of the state, we identified the need to have computational efficient models and explored model compression via pruning.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningModel CompressionTraffic Signal ControlSimilar Papers 제목 키워드 기반
Traffic signal control optimization under severe incident conditions using Genetic Algorithm
Traffic control optimization is a challenging task for various traffic centres in the world and majority of approaches focus only on applying adaptive methods under normal (recurrent) traffic conditions. But optimizing t…
Traffic Signal ControlMoveLight: Enhancing Traffic Signal Control through Movement-Centric Deep Reinforcement Learning
This paper introduces MoveLight, a novel traffic signal control system that enhances urban traffic management through movement-centric deep reinforcement learning. By leveraging detailed real-time data and advanced machi…
Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning+1Deep Reinforcement Learning for Adaptive Traffic Signal Control
Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers …
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Reinforcement Learning for Adaptive Traffic Signal Control: Turn-Based and Time-Based Approaches to Reduce Congestion
The growing demand for road use in urban areas has led to significant traffic congestion, posing challenges that are costly to mitigate through infrastructure expansion alone. As an alternative, optimizing existing traff…
reinforcement-learningReinforcement Learning (RL)Traffic Signal ControlMalLight: Influence-Aware Coordinated Traffic Signal Control for Traffic Signal Malfunctions
Urban traffic is subject to disruptions that cause extended waiting time and safety issues at signalized intersections. While numerous studies have addressed the issue of intelligent traffic systems in the context of var…
Reinforcement Learning (RL)Traffic Signal Control