A Differentiated Reward Method for Reinforcement Learning based Multi-Vehicle Cooperative Decision-Making Algorithms

2025-02-01 · Ye Han, Lijun Zhang, Dejian Meng

Reinforcement learning (RL) shows great potential for optimizing multi-vehicle cooperative driving strategies through the state-action-reward feedback loop, but it still faces challenges such as low sample efficiency. This paper proposes a differentiated reward method based on steady-state transition systems, which incorporates state transition gradient information into the reward design by analyzing traffic flow characteristics, aiming to optimize action selection and policy learning in multi-vehicle cooperative decision-making. The performance of the proposed method is validated in RL algorithms such as MAPPO, MADQN, and QMIX under varying autonomous vehicle penetration. The results show that the differentiated reward method significantly accelerates training convergence and outperforms centering reward and others in terms of traffic efficiency, safety, and action rationality. Additionally, the method demonstrates strong scalability and environmental adaptability, providing a novel approach for multi-agent cooperative decision-making in complex traffic scenarios.

📄 PDF Abstract BibTeX arXiv:2502.00352

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Reinforcement Learning (RL)

Learning Reward Models for Cooperative Trajectory Planning with Inverse Reinforcement Learning and Monte Carlo Tree Search

2022-02-14 · Karl Kurzer, Matthias Bitzer, J. Marius Zöllner

Cooperative trajectory planning methods for automated vehicles can solve traffic scenarios that require a high degree of cooperation between traffic participants. However, for cooperative systems to integrate into human-…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Robust Distributed Cooperative Path-Following and Local Replanning for Multi-UAVs Under Differentiated Low-Altitude Paths

2026-03-25 · Zimao Sheng, Zirui Yu, Hong'an Yang arxiv

Multiple fixed-wing unmanned aerial vehicles (multi-UAVs) encounter significant challenges in cooperative path following over complex Digital Elevation Model (DEM) low-altitude airspace, including wind field disturbances…

Decentralized Cooperative Lane Changing at Freeway Weaving Areas Using Multi-Agent Deep Reinforcement Learning

2021-10-05 · Yi Hou, Peter Graf

Frequent lane changes during congestion at freeway bottlenecks such as merge and weaving areas further reduce roadway capacity. The emergence of deep reinforcement learning (RL) and connected and automated vehicle techno…

Deep Reinforcement Learning Reinforcement Learning (RL)

Cooperative Lane Changing via Deep Reinforcement Learning

2019-06-20 · Guan Wang, Jianming Hu, Zhiheng Li, Li Li

In this paper, we study how to learn an appropriate lane changing strategy for autonomous vehicles by using deep reinforcement learning. We show that the reward of the system should consider the overall traffic efficienc…

Autonomous Vehicles Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

An LLM-Powered Cooperative Framework for Large-Scale Multi-Vehicle Navigation

2025-10-09 · Yuping Zhou, Siqi Lai, Jindong Han, Hao Liu arxiv

The rise of Internet of Vehicles (IoV) technologies is transforming traffic management from isolated control to a collective, multi-vehicle process. At the heart of this shift is multi-vehicle dynamic navigation, which r…

Reinforcement Learning