Deep Reinforcement Learning-based Intelligent Traffic Signal Controls with Optimized CO2 emissions

2023-10-19 · Pedram Agand, Alexey Iskrov, Mo Chen

Nowadays, transportation networks face the challenge of sub-optimal control policies that can have adverse effects on human health, the environment, and contribute to traffic congestion. Increased levels of air pollution and extended commute times caused by traffic bottlenecks make intersection traffic signal controllers a crucial component of modern transportation infrastructure. Despite several adaptive traffic signal controllers in literature, limited research has been conducted on their comparative performance. Furthermore, despite carbon dioxide (CO2) emissions' significance as a global issue, the literature has paid limited attention to this area. In this report, we propose EcoLight, a reward shaping scheme for reinforcement learning algorithms that not only reduces CO2 emissions but also achieves competitive results in metrics such as travel time. We compare the performance of tabular Q-Learning, DQN, SARSA, and A2C algorithms using metrics such as travel time, CO2 emissions, waiting time, and stopped time. Our evaluation considers multiple scenarios that encompass a range of road users (trucks, buses, cars) with varying pollution levels.

📄 PDF Abstract BibTeX arXiv:2310.13129

Code (1)

pagand/eco-light 공식 구현

Tasks

Deep Reinforcement LearningQ-Learning

Methods 이 논문이 사용한 방법론

Travel 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

A2C A2C, or Advantage Actor Critic, is a synchronous version of the A3C policy gradient method. As an alternative to the asynchronous…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenario

2019-05-13 · Huichu Zhang, Siyuan Feng, Chang Liu, Yaoyao Ding 외

Traffic signal control is an emerging application scenario for reinforcement learning. Besides being as an important problem that affects people's daily life in commuting, traffic signal control poses its unique challeng…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

A Survey on Traffic Signal Control Methods

2019-04-17 · Hua Wei, Guanjie Zheng, Vikash Gayah, Zhenhui Li

Traffic signal control is an important and challenging real-world problem, which aims to minimize the travel time of vehicles by coordinating their movements at the road intersections. Current traffic signal control syst…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Survey+1

Scalable Traffic Signal Controls using Fog-Cloud Based Multiagent Reinforcement Learning

2021-10-11 · Paul, Ha, Sikai Chen, Runjia Du 외

Optimizing traffic signal control (TSC) at intersections continues to pose a challenging problem, particularly for large-scale traffic networks. It has been shown in past research that it is feasible to optimize the oper…

Deep Reinforcement Learning Graph Attention reinforcement-learning Reinforcement Learning (RL)+1

Integrating independent and centralized multi-agent reinforcement learning for traffic signal network optimization

2019-09-23 · Zhi Zhang, Jiachen Yang, Hongyuan Zha

Traffic congestion in metropolitan areas is a world-wide problem that can be ameliorated by traffic lights that respond dynamically to real-time conditions. Recent studies applying deep reinforcement learning (RL) to opt…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Quantifying the Impact of Non-Stationarity in Reinforcement Learning-Based Traffic Signal Control

2020-04-09 · Lucas N. Alegre, Ana L. C. Bazzan, Bruno C. da Silva

In reinforcement learning (RL), dealing with non-stationarity is a challenging issue. However, some domains such as traffic optimization are inherently non-stationary. Causes for and effects of this are manifold. In part…

Reinforcement Learning Reinforcement Learning (RL)Traffic Signal Control