Random Ensemble Reinforcement Learning for Traffic Signal Control

2022-03-10 · Ruijie Qi, Jianbin Huang, He Li, Qinglin Tan, Longji Huang, Jiangtao Cui

Traffic signal control is a significant part of the construction of intelligent transportation. An efficient traffic signal control strategy can reduce traffic congestion, improve urban road traffic efficiency and facilitate people's lives. Existing reinforcement learning approaches for traffic signal control mainly focus on learning through a separate neural network. Such an independent neural network may fall into the local optimum of the training results. Worse more, the collected data can only be sampled once, so the data utilization rate is low. Therefore, we propose the Random Ensemble Double DQN Light (RELight) model. It can dynamically learn traffic signal control strategies through reinforcement learning and combine random ensemble learning to avoid falling into the local optimum to reach the optimal strategy. Moreover, we introduce the Update-To-Data (UTD) ratio to control the number of data reuses to improve the problem of low data utilization. In addition, we have conducted sufficient experiments on synthetic data and real-world data to prove that our proposed method can achieve better traffic signal control effects than the existing optimal methods.

📄 PDF Abstract BibTeX arXiv:2203.05961

Code (0)

등록된 구현이 없습니다.

Tasks

Ensemble Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Traffic Signal Control

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Double Q-learning Double Q-learning is an off-policy reinforcement learning algorithm that utilises double estimation to counteract overestimation problems with traditional Q-learning. The…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Double DQN 설명 없음

ModelLight: Model-Based Meta-Reinforcement Learning for Traffic Signal Control

2021-11-15 · Xingshuai Huang, Di wu, Michael Jenkin, Benoit Boulet

Traffic signal control is of critical importance for the effective use of transportation infrastructures. The rapid increase of vehicle traffic and changes in traffic patterns make traffic signal control more and more ch…

Meta-Learning Meta Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Improving the generalizability and robustness of large-scale traffic signal control

2023-06-02 · Tianyu Shi, Francois-Xavier Devailly, Denis Larocque, Laurent Charlin

A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-d…

Deep Reinforcement Learning Distributional Reinforcement Learning Multi-agent Reinforcement Learning quantile regression+4

CuraLight: Debate-Guided Data Curation for LLM-Centered Traffic Signal Control

2026-04-07 · Qing Guo, Xinhang Li, Junyu Chen, Zheng Guo 외 arxiv

Traffic signal control (TSC) is a core component of intelligent transportation systems (ITS), aiming to reduce congestion, emissions, and travel time. Recent approaches based on reinforcement learning (RL) and large lang…

Reinforcement Learning

Traffic Signal Control with Communicative Deep Reinforcement Learning Agents: a Case Study

2021-07-03 · Paolo Fazzini, Isaac Wheeler, Francesco Petracchini

In this work we analyze Multi-Agent Advantage Actor-Critic (MA2C) a recently proposed multi-agent reinforcement learning algorithm that can be applied to adaptive traffic signal control (ATSC) problems. To evaluate its p…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Reinforcement Learning-Based Traffic Signal Control for IoT-Enabled Intersections

2026-06-20 · Yousef AlSaqabi arxiv

Urban traffic congestion remains a persistent challenge in car-dependent cities, imposing significant economic and societal costs. Traffic signal systems are increasingly deployed as networked cyber-physical components w…