Learning to Influence Vehicles' Routing in Mixed-Autonomy Networks by Dynamically Controlling the Headway of Autonomous Cars
It is known that autonomous cars can increase road capacities by maintaining a smaller headway through vehicle platooning. Recent works have shown that these capacity increases can influence vehicles' route choices in unexpected ways similar to the well-known Braess's paradox, such that the network congestion might increase. In this paper, we propose that in mixed-autonomy networks, i.e., networks where roads are shared between human-driven and autonomous cars, the headway of autonomous cars can be directly controlled to influence vehicles' routing and reduce congestion. We argue that the headway of autonomous cars -- and consequently the capacity of link segments -- is not just a fixed design choice; but rather, it can be leveraged as an {infrastructure control} strategy to {dynamically} regulate capacities. Imagine that similar to variable speed limits which regulate the maximum speed of vehicles on a road segment, a control policy regulates the headway of autonomous cars along each road segment. We seek to influence vehicles' route choices by directly controlling the headway of autonomous cars to prevent Braess-like unexpected outcomes and increase network efficiency. We model the dynamics of mixed-autonomy traffic networks while accounting for the vehicles' route choice dynamics. We train an RL policy that learns to regulate the headway of autonomous cars such that the total travel time in the network is minimized. We will show empirically that our trained policy can not only prevent Braess-like inefficiencies but also decrease total travel time.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Joint routing and pricing control in congested mixed autonomy networks
Routing controllability of connected and autonomous vehicles (CAVs) has been shown to reduce the adverse effects of selfish routing on the network efficiency. However, the assumption that CAV owners would readily allow t…
Autonomous VehiclesMulti-Objective Reinforcement Learning for Large-Scale Mixed Traffic Control
Effective mixed traffic control requires balancing efficiency, fairness, and safety. Existing approaches excel at optimizing efficiency and enforcing safety constraints but lack mechanisms to ensure equitable service, re…
Reinforcement LearningTrust-Aware Embodied Bayesian Persuasion for Mixed-Autonomy
Safe and efficient interaction between autonomous vehicles (AVs) and human-driven vehicles (HVs) is a critical challenge for future transportation systems. While game-theoretic models capture how AVs influence HVs, they …
Autonomous VehiclesReinforcement Learning for Mixed Autonomy Intersections
We propose a model-free reinforcement learning method for controlling mixed autonomy traffic in simulated traffic networks with through-traffic-only two-way and four-way intersections. Our method utilizes multi-agent pol…
Multi-Task Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Event-triggered Boundary Control of Mixed-autonomy Traffic
Control problems of mixed-autonomy traffic systems that consist of both human-driven vehicles (HV) and autonomous vehicles (AV), have gained increasing attention. This paper focuses on suppressing traffic oscillations in…
Autonomous VehiclesFriction