Reinforcement Learning for Mixed Autonomy Intersections
We propose a model-free reinforcement learning method for controlling mixed autonomy traffic in simulated traffic networks with through-traffic-only two-way and four-way intersections. Our method utilizes multi-agent policy decomposition which allows decentralized control based on local observations for an arbitrary number of controlled vehicles. We demonstrate that, even without reward shaping, reinforcement learning learns to coordinate the vehicles to exhibit traffic signal-like behaviors, achieving near-optimal throughput with 33-50% controlled vehicles. With the help of multi-task learning and transfer learning, we show that this behavior generalizes across inflow rates and size of the traffic network. Our code, models, and videos of results are available at https://github.com/ZhongxiaYan/mixed_autonomy_intersections.
Code (1)
Tasks
Multi-Task Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Transfer LearningSimilar Papers 제목 키워드 기반
V2X-Lead: LiDAR-based End-to-End Autonomous Driving with Vehicle-to-Everything Communication Integration
This paper presents a LiDAR-based end-to-end autonomous driving method with Vehicle-to-Everything (V2X) communication integration, termed V2X-Lead, to address the challenges of navigating unregulated urban scenarios unde…
Autonomous DrivingAutonomous VehiclesDeep Reinforcement LearningMulti-Task LearningLarge-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning
Traffic congestion remains a significant challenge in modern urban networks. Autonomous driving technologies have emerged as a potential solution. Among traffic control methods, reinforcement learning has shown superior …
Autonomous DrivingMulti-agent Reinforcement Learningreinforcement-learningReinforcement LearningOptimizing Multi-Lane Intersection Performance in Mixed Autonomy Environments
One of the main challenges in managing traffic at multilane intersections is ensuring smooth coordination between human-driven vehicles (HDVs) and connected autonomous vehicles (CAVs). This paper presents a novel traffic…
Reinforcement LearningAutonomous VehiclesDecision MakingCourteous Behavior of Automated Vehicles at Unsignalized Intersections via Reinforcement Learning
The transition from today's mostly human-driven traffic to a purely automated one will be a gradual evolution, with the effect that we will likely experience mixed traffic in the near future. Connected and automated vehi…
Autonomous VehiclesCollision AvoidanceDeep Reinforcement LearningManagement+3Flow: A Modular Learning Framework for Mixed Autonomy Traffic
The rapid development of autonomous vehicles (AVs) holds vast potential for transportation systems through improved safety, efficiency, and access to mobility. However, the progression of these impacts, as AVs are adopte…
Autonomous VehiclesDeep Reinforcement LearningReinforcement LearningReinforcement Learning (RL)