Batch-Augmented Multi-Agent Reinforcement Learning for Efficient Traffic Signal Optimization

2020-05-19 · Yueh-Hua Wu, I-Hau Yeh, David Hu, Hong-Yuan Mark Liao

The goal of this work is to provide a viable solution based on reinforcement learning for traffic signal control problems. Although the state-of-the-art reinforcement learning approaches have yielded great success in a variety of domains, directly applying it to alleviate traffic congestion can be challenging, considering the requirement of high sample efficiency and how training data is gathered. In this work, we address several challenges that we encountered when we attempted to mitigate serious traffic congestion occurring in a metropolitan area. Specifically, we are required to provide a solution that is able to (1) handle the traffic signal control when certain surveillance cameras that retrieve information for reinforcement learning are down, (2) learn from batch data without a traffic simulator, and (3) make control decisions without shared information across intersections. We present a two-stage framework to deal with the above-mentioned situations. The framework can be decomposed into an Evolution Strategies approach that gives a fixed-time traffic signal control schedule and a multi-agent off-policy reinforcement learning that is capable of learning from batch data with the aid of three proposed components, bounded action, batch augmentation, and surrogate reward clipping. Our experiments show that the proposed framework reduces traffic congestion by 36% in terms of waiting time compared with the currently used fixed-time traffic signal plan. Furthermore, the framework requires only 600 queries to a simulator to achieve the result.

📄 PDF Abstract BibTeX arXiv:2005.09624

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Traffic Signal Control

Adaptive Inference Batching using Policy Gradients

2026-07-06 · Ruslan Sharifullin arxiv

Inference serving systems must balance throughput and latency under bursty, heterogeneous workloads, yet the industry standard remains static batching policies that require manual tuning and cannot adapt to shifting traf…

Reinforcement Learning

ADLight: A Universal Approach of Traffic Signal Control with Augmented Data Using Reinforcement Learning

2022-10-24 · Maonan Wang, Yutong Xu, Xi Xiong, Yuheng Kan 외

Traffic signal control has the potential to reduce congestion in dynamic networks. Recent studies show that traffic signal control with reinforcement learning (RL) methods can significantly reduce the average waiting tim…

Data Augmentation reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

ROAD: Responsibility-Oriented Reward Design for Reinforcement Learning in Autonomous Driving

2025-05-30 · Yongming Chen, Miner Chen, Liewen Liao, Mingyang Jiang 외

Reinforcement learning (RL) in autonomous driving employs a trial-and-error mechanism, enhancing robustness in unpredictable environments. However, crafting effective reward functions remains challenging, as conventional…

Autonomous Driving Decision Making Reinforcement Learning (RL)Retrieval-augmented Generation

Optimizing Traffic Lights with Multi-agent Deep Reinforcement Learning and V2X communication

2020-02-23 · Azhar Hussain, Tong Wang, Cao Jiahua

We consider a system to optimize duration of traffic signals using multi-agent deep reinforcement learning and Vehicle-to-Everything (V2X) communication. This system aims at analyzing independent and shared rewards for m…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-Agent Broad Reinforcement Learning for Intelligent Traffic Light Control

2022-03-08 · Ruijie Zhu, Lulu Li, Shuning Wu, Pei Lv 외

Intelligent Traffic Light Control System (ITLCS) is a typical Multi-Agent System (MAS), which comprises multiple roads and traffic lights.Constructing a model of MAS for ITLCS is the basis to alleviate traffic congestion…