Driving in Dense Traffic with Model-Free Reinforcement Learning
Traditional planning and control methods could fail to find a feasible trajectory for an autonomous vehicle to execute amongst dense traffic on roads. This is because the obstacle-free volume in spacetime is very small in these scenarios for the vehicle to drive through. However, that does not mean the task is infeasible since human drivers are known to be able to drive amongst dense traffic by leveraging the cooperativeness of other drivers to open a gap. The traditional methods fail to take into account the fact that the actions taken by an agent affect the behaviour of other vehicles on the road. In this work, we rely on the ability of deep reinforcement learning to implicitly model such interactions and learn a continuous control policy over the action space of an autonomous vehicle. The application we consider requires our agent to negotiate and open a gap in the road in order to successfully merge or change lanes. Our policy learns to repeatedly probe into the target road lane while trying to find a safe spot to move in to. We compare against two model-predictive control-based algorithms and show that our policy outperforms them in simulation.
Code (2)
Tasks
continuous-controlContinuous ControlDeep Reinforcement LearningModel Predictive Controlreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
TSC: Topology-Conditioned Stackelberg Coordination for Multi-Agent Reinforcement Learning in Interactive Driving
Safe and efficient autonomous driving in dense traffic is fundamentally a decentralized multi-agent coordination problem, where interactions at conflict points such as merging and weaving must be resolved reliably under …
Multi-agent Reinforcement LearningAutonomous DrivingLearning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarios
Autonomous navigation in dense traffic scenarios remains challenging for autonomous vehicles (AVs) because the intentions of other drivers are not directly observable and AVs have to deal with a wide range of driving beh…
Autonomous NavigationAutonomous VehiclesDeep Reinforcement LearningMotion Planning+2CADRE: A Cascade Deep Reinforcement Learning Framework for Vision-based Autonomous Urban Driving
Vision-based autonomous urban driving in dense traffic is quite challenging due to the complicated urban environment and the dynamics of the driving behaviors. Widely-applied methods either heavily rely on hand-crafted r…
Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Traffic
Multi-task intersection navigation including the unprotected turning left, turning right, and going straight in dense traffic is still a challenging task for autonomous driving. For the human driver, the negotiation skil…
Autonomous Drivingreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors
When autonomous vehicles are deployed on public roads, they will encounter countless and diverse driving situations. Many manually designed driving policies are difficult to scale to the real world. Fortunately, reinforc…
Autonomous DrivingAutonomous Vehiclesreinforcement-learning