Towards Robust On-Ramp Merging via Augmented Multimodal Reinforcement Learning

2022-07-21 · Gaurav Bagwe, Jian Li, Xiaoyong Yuan, Lan Zhang

Despite the success of AI-enabled onboard perception, on-ramp merging has been one of the main challenges for autonomous driving. Due to limited sensing range of onboard sensors, a merging vehicle can hardly observe main road conditions and merge properly. By leveraging the wireless communications between connected and automated vehicles (CAVs), a merging CAV has potential to proactively obtain the intentions of nearby vehicles. However, CAVs can be prone to inaccurate observations, such as the noisy basic safety messages (BSM) and poor quality surveillance images. In this paper, we present a novel approach for Robust on-ramp merge of CAVs via Augmented and Multi-modal Reinforcement Learning, named by RAMRL. Specifically, we formulate the on-ramp merging problem as a Markov decision process (MDP) by taking driving safety, comfort driving behavior, and traffic efficiency into account. To provide reliable merging maneuvers, we simultaneously leverage BSM and surveillance images for multi-modal observation, which is used to learn a policy model through proximal policy optimization (PPO). Moreover, to improve data efficiency and provide better generalization performance, we train the policy model with augmented data (e.g., noisy BSM and noisy surveillance images). Extensive experiments are conducted with Simulation of Urban MObility (SUMO) platform under two typical merging scenarios. Experimental results demonstrate the effectiveness and efficiency of our robust on-ramp merging design.

📄 PDF Abstract BibTeX arXiv:2208.07307

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Co-Optimization of On-Ramp Merging and Plug-In Hybrid Electric Vehicle Power Split Using Deep Reinforcement Learning

2022-03-07 · Yuan Lin, John McPhee, Nasser L. Azad

Current research on Deep Reinforcement Learning (DRL) for automated on-ramp merging neglects vehicle powertrain and dynamics. This work considers automated on-ramp merging for a power-split Plug-In Hybrid Electric Vehicl…

Deep Reinforcement Learning energy management Management

Safe Reinforcement Learning with Probabilistic Control Barrier Functions for Ramp Merging

2022-12-01 · Soumith Udatha, Yiwei Lyu, John Dolan

Prior work has looked at applying reinforcement learning and imitation learning approaches to autonomous driving scenarios, but either the safety or the efficiency of the algorithm is compromised. With the use of control…

Autonomous Driving Imitation Learning reinforcement-learning Reinforcement Learning+2

Z-Merge: Multi-Agent Reinforcement Learning for On-Ramp Merging with Zone-Specific V2X Traffic Information

2025-11-18 · Yassine Ibork, Myounggyu Won, Lokesh Das arxiv

Ramp merging is a critical and challenging task for autonomous vehicles (AVs), particularly in mixed traffic environments with human-driven vehicles (HVs). Existing approaches typically rely on either lane-changing or in…

Multi-agent Reinforcement Learning Autonomous Vehicles Continuous Control

Autonomous Ramp Merge Maneuver Based on Reinforcement Learning with Continuous Action Space

2018-03-25 · Pin Wang, Ching-Yao Chan

Ramp merging is a critical maneuver for road safety and traffic efficiency. Most of the current automated driving systems developed by multiple automobile manufacturers and suppliers are typically limited to restricted a…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

PPO-Based Vehicle Control for Ramp Merging Scheme Assisted by Enhanced C-V2X

2025-01-22 · Qiong Wu, Maoxin Ji, Pingyi Fan, Kezhi Wang 외

On-ramp merging presents a critical challenge in autonomous driving, as vehicles from merging lanes need to dynamically adjust their positions and speeds while monitoring traffic on the main road to prevent collisions. T…

Autonomous Driving