Cooperative Multi-Objective Reinforcement Learning for Traffic Signal Control and Carbon Emission Reduction

2023-06-16 · Cheng Ruei Tang, Jun Wei Hsieh, Shin You Teng

Existing traffic signal control systems rely on oversimplified rule-based methods, and even RL-based methods are often suboptimal and unstable. To address this, we propose a cooperative multi-objective architecture called Multi-Objective Multi-Agent Deep Deterministic Policy Gradient (MOMA-DDPG), which estimates multiple reward terms for traffic signal control optimization using age-decaying weights. Our approach involves two types of agents: one focuses on optimizing local traffic at each intersection, while the other aims to optimize global traffic throughput. We evaluate our method using real-world traffic data collected from an Asian country's traffic cameras. Despite the inclusion of a global agent, our solution remains decentralized as this agent is no longer necessary during the inference stage. Our results demonstrate the effectiveness of MOMA-DDPG, outperforming state-of-the-art methods across all performance metrics. Additionally, our proposed system minimizes both waiting time and carbon emissions. Notably, this paper is the first to link carbon emissions and global agents in traffic signal control.

📄 PDF Abstract BibTeX arXiv:2306.09662

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Objective Reinforcement LearningTraffic Signal Control

Cooperative Reinforcement Learning on Traffic Signal Control

2022-05-23 · Chi-Chun Chao, Jun-Wei Hsieh, Bor-Shiun Wang

Traffic signal control is a challenging real-world problem aiming to minimize overall travel time by coordinating vehicle movements at road intersections. Existing traffic signal control systems in use still rely heavily…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Traffic Signal Control

Independent Reinforcement Learning for Weakly Cooperative Multiagent Traffic Control Problem

2021-04-22 · Chengwei Zhang, Shan Jin, Wanli Xue, Xiaofei Xie 외

The adaptive traffic signal control (ATSC) problem can be modeled as a multiagent cooperative game among urban intersections, where intersections cooperate to optimize their common goal. Recently, reinforcement learning …

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+2

Hybrid Differential Reward: Combining Temporal Difference and Action Gradients for Efficient Multi-Agent Reinforcement Learning in Cooperative Driving

2025-11-21 · Ye Han, Lijun Zhang, Dejian Meng, Zhuang Zhang arxiv

In multi-vehicle cooperative driving tasks involving high-frequency continuous control, traditional state-based reward functions suffer from the issue of vanishing reward differences. This phenomenon results in a low sig…

Multi-agent Reinforcement Learning Continuous Control

Tensor-based Cooperative Control for Large Scale Multi-intersection Traffic Signal Using Deep Reinforcement Learning and Imitation Learning

2019-09-30 · Yusen Huo, Qinghua Tao, Jianming Hu

Traffic signal control has long been considered as a critical topic in intelligent transportation systems. Most existing learning methods mainly focus on isolated intersections and suffer from inefficient training. This …

Deep Reinforcement Learning Imitation Learning Multi-Task Learning reinforcement-learning+3

Learning Coordinated Preference for Multi-Objective Multi-Agent Reinforcement Learning

2026-06-12 · Pengxin Wang, Lihao Guo, Yi Xie, Bo Liu 외 arxiv

Cooperative multi-objective multi-agent reinforcement learning (MOMARL) models team decision making under multiple, potentially conflicting objectives. In this setting, conflicts arise not only across objectives but also…

Multi-agent Reinforcement Learning Decision Making