Traffic Smoothing Controllers for Autonomous Vehicles Using Deep Reinforcement Learning and Real-World Trajectory Data

2024-01-18 · Nathan Lichtlé, Kathy Jang, Adit Shah, Eugene Vinitsky, Jonathan W. Lee, Alexandre M. Bayen

Designing traffic-smoothing cruise controllers that can be deployed onto autonomous vehicles is a key step towards improving traffic flow, reducing congestion, and enhancing fuel efficiency in mixed autonomy traffic. We bypass the common issue of having to carefully fine-tune a large traffic microsimulator by leveraging real-world trajectory data from the I-24 highway in Tennessee, replayed in a one-lane simulation. Using standard deep reinforcement learning methods, we train energy-reducing wave-smoothing policies. As an input to the agent, we observe the speed and distance of only the vehicle in front, which are local states readily available on most recent vehicles, as well as non-local observations about the downstream state of the traffic. We show that at a low 4% autonomous vehicle penetration rate, we achieve significant fuel savings of over 15% on trajectories exhibiting many stop-and-go waves. Finally, we analyze the smoothing effect of the controllers and demonstrate robustness to adding lane-changing into the simulation as well as the removal of downstream information.

📄 PDF Abstract BibTeX arXiv:2401.09666

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesDeep Reinforcement Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Reinforcement Learning Based Oscillation Dampening: Scaling up Single-Agent RL algorithms to a 100 AV highway field operational test

2024-02-26 · Kathy Jang, Nathan Lichtlé, Eugene Vinitsky, Adit Shah 외

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, un…

Autonomous Driving Reinforcement Learning (RL)Self-Driving Cars

Optimal Smoothing Distribution Exploration for Backdoor Neutralization in Deep Learning-based Traffic Systems

2023-03-24 · Yue Wang, Wending Li, Michail Maniatakos, Saif Eddin Jabari

Deep Reinforcement Learning (DRL) enhances the efficiency of Autonomous Vehicles (AV), but also makes them susceptible to backdoor attacks that can result in traffic congestion or collisions. Backdoor functionality is ty…

Autonomous Vehicles Deep Reinforcement Learning image-classification Image Classification

A Systematic Study of Multi-Agent Deep Reinforcement Learning for Safe and Robust Autonomous Highway Ramp Entry

2024-11-21 · Larry Schester, Luis E. Ortiz

Vehicles today can drive themselves on highways and driverless robotaxis operate in major cities, with more sophisticated levels of autonomous driving expected to be available and become more common in the future. Yet, t…

Autonomous Driving Deep Reinforcement Learning

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

2021-01-17 · Jinning Li, Liting Sun, Jianyu Chen, Masayoshi Tomizuka 외

Autonomous vehicles need to handle various traffic conditions and make safe and efficient decisions and maneuvers. However, on the one hand, a single optimization/sampling-based motion planner cannot efficiently generate…

Autonomous Vehicles reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Smoothing traffic flow through automated vehicle control with optimal parameter selection

2025-01-02 · Shian Wang, Jose Acedo Aguilar, Miguel Velez-Reyes

Stop-and-go traffic waves are known for reducing the efficiency of transportation systems by increasing traffic oscillations and energy consumption. In this study, we develop an approach to synthesize a class of additive…