Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changing
Lane-changing (LC) is a challenging scenario for connected and automated vehicles (CAVs) because of the complex dynamics and high uncertainty of the traffic environment. This challenge can be handled by deep reinforcement learning (DRL) approaches, leveraging their data-driven and model-free nature. Our previous work proposed a cooperative lane-changing in mixed traffic (CLCMT) mechanism based on TD3 to facilitate an optimal lane-changing strategy. This study enhances the current CLCMT mechanism by considering both the uncertainty of the human-driven vehicles (HVs) and the microscopic interactions between HVs and CAVs. The state-of-the-art (SOTA) DRL algorithms including DDPG, TD3, SAC, and PPO are utilized to deal with the formulated MDP with continuous actions. Performance comparison among the four DRL algorithms demonstrates that DDPG, TD3, and PPO algorithms can deal with uncertainty in traffic environments and learn well-performed LC strategies in terms of safety, efficiency, comfort, and ecology. The PPO algorithm outperforms the other three algorithms, regarding a higher reward, fewer exploration mistakes and crashes, and a more comfortable and ecology LC strategy. The improvements promise CLCMT mechanism greater advantages in the LC motion planning of CAVs.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningMotion PlanningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Cooperative Formation of Autonomous Vehicles in Mixed Traffic Flow: Beyond Platooning
Cooperative formation and control of autonomous vehicles (AVs) promise increased efficiency and safety on public roads. In mixed traffic flow consisting of AVs and human-driven vehicles (HDVs), the prevailing platooning …
Autonomous VehiclesPartially Connected Automated Vehicle Cooperative Control Strategy with a Deep Reinforcement Learning Approach
This paper proposes a cooperative strategy of connected and automated vehicles (CAVs) longitudinal control for partially connected and automated traffic environment based on deep reinforcement learning (DRL) algorithm, w…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Evaluation of Connected Vehicle Identification-Aware Mixed Traffic Freeway Cooperative Merging
Cooperative on-ramp merging control for connected automated vehicles (CAVs) has been extensively investigated. However, they did neglect the connected vehicle identification process, which is a must for CAV cooperations.…
Evidence and quantification of cooperation of driving agents in mixed traffic flow
Cooperation is a ubiquitous phenomenon in many natural, social, and engineered systems with multiple agents. Understanding the formation of cooperation in mixed traffic is of theoretical interest in its own right, and co…
Distributed data-driven predictive control for cooperatively smoothing mixed traffic flow
Cooperative control of connected and automated vehicles (CAVs) promises smoother traffic flow. In mixed traffic, where human-driven vehicles with unknown dynamics coexist, data-driven predictive control techniques allow …
LEMMA