Unified Automatic Control of Vehicular Systems with Reinforcement Learning

2022-07-30 · Zhongxia Yan, Abdul Rahman Kreidieh, Eugene Vinitsky, Alexandre M. Bayen, Cathy Wu

Emerging vehicular systems with increasing proportions of automated components present opportunities for optimal control to mitigate congestion and increase efficiency. There has been a recent interest in applying deep reinforcement learning (DRL) to these nonlinear dynamical systems for the automatic design of effective control strategies. Despite conceptual advantages of DRL being model-free, studies typically nonetheless rely on training setups that are painstakingly specialized to specific vehicular systems. This is a key challenge to efficient analysis of diverse vehicular and mobility systems. To this end, this article contributes a streamlined methodology for vehicular microsimulation and discovers high performance control strategies with minimal manual design. A variable-agent, multi-task approach is presented for optimization of vehicular Partially Observed Markov Decision Processes. The methodology is experimentally validated on mixed autonomy traffic systems, where fractions of vehicles are automated; empirical improvement, typically 15-60% over a human driving baseline, is observed in all configurations of six diverse open or closed traffic systems. The study reveals numerous emergent behaviors resembling wave mitigation, traffic signaling, and ramp metering. Finally, the emergent behaviors are analyzed to produce interpretable control strategies, which are validated against the learned control strategies.

📄 PDF Abstract BibTeX arXiv:2208.00268

Code (1)

mit-wu-lab/automatic_vehicular_control 공식 구현 pytorch

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

VRLS: A Unified Reinforcement Learning Scheduler for Vehicle-to-Vehicle Communications

2019-07-22 · Taylan Şahin, Ramin Khalili, Mate Boban, Adam Wolisz

Vehicle-to-vehicle (V2V) communications have distinct challenges that need to be taken into account when scheduling the radio resources. Although centralized schedulers (e.g., located on base stations) could be utilized …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Scheduling+1

A Multi-intersection Vehicular Cooperative Control based on End-Edge-Cloud Computing

2020-12-01 · Mingzhi Jiang, Tianhao Wu, Zhe Wang, Yi Gong 외

Cooperative Intelligent Transportation Systems (C-ITS) will change the modes of road safety and traffic management, especially at intersections without traffic lights, namely unsignalized intersections. Existing research…

Cloud Computing Management

Robust Longitudinal Control for Vehicular Autonomous Platoons Using Deep Reinforcement Learning

2022-05-31 · Armando Alves Neto, Leonardo Amaral Mozelli

In the last few years, researchers have applied machine learning strategies in the context of vehicular platoons to increase the safety and efficiency of cooperative transportation. Reinforcement Learning methods have be…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

VoI-Driven Joint Optimization of Control and Communication in Vehicular Digital Twin Network

2025-05-12 · Lei Lei, Kan Zheng, Jie Mei, Xuemin 외

The vision of sixth-generation (6G) wireless networks paves the way for the seamless integration of digital twins into vehicular networks, giving rise to a Vehicular Digital Twin Network (VDTN). The large amount of compu…

Deep Reinforcement Learning

SCAR: State-Space Compression for Scalable AI-Based Network Management of Vehicular Services

2025-08-08 · Ioan-Sorin Comsa, Purav Shah, Karthik Vaidhyanathan, Deepak Gangadharan 외 arxiv

The increasing demand for connected vehicular services poses significant challenges for AI-based network and service management due to the high volume and rapid variability of network state information. Traditional manag…

Reinforcement Learning