paper-with-me

Papers

Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery

2022-07-24 · Xianqi He, Lin Yang, Chao Lu, Zirui Li, Jianwei Gong

In urban environments, the complex and uncertain intersection scenarios are challenging for autonomous driving. To ensure safety, it is crucial to develop an adaptive decision making system that can handle the interaction with other vehicles. Manually designed model-based methods are reliable in common scenarios. But in uncertain environments, they are not reliable, so learning-based methods are proposed, especially reinforcement learning (RL) methods. However, current RL methods need retraining when the scenarios change. In other words, current RL methods cannot reuse accumulated knowledge. They forget learned knowledge when new scenarios are given. To solve this problem, we propose a hierarchical framework that can autonomously accumulate and reuse knowledge. The proposed method combines the idea of motion primitives (MPs) with hierarchical reinforcement learning (HRL). It decomposes complex problems into multiple basic subtasks to reduce the difficulty. The proposed method and other baseline methods are tested in a challenging intersection scenario based on the CARLA simulator. The intersection scenario contains three different subtasks that can reflect the complexity and uncertainty of real traffic flow. After offline learning and testing, the proposed method is proved to have the best performance among all methods.

📄 PDF Abstract BibTeX arXiv:2207.11724

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingAutonomous VehiclesDecision MakingHierarchical Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

Similar Papers 제목 키워드 기반

Decision-making at Unsignalized Intersection for Autonomous Vehicles: Left-turn Maneuver with Deep Reinforcement Learning

2020-08-14 · Feng Wang, Dongjie Shi, Teng Liu, Xiaolin Tang

Decision-making module enables autonomous vehicles to reach appropriate maneuvers in the complex urban environments, especially the intersection situations. This work proposes a deep reinforcement learning (DRL) based le…

Autonomous VehiclesDecision MakingDeep Reinforcement LearningQ-Learning+2

Decision Making for Autonomous Vehicles

2023-04-27 · Xinchen Li, Levent Guvenc, Bilin Aksun-Guvenc

This paper is on decision making of autonomous vehicles for handling roundabouts. The round intersection is introduced first followed by the Markov Decision Processes (MDP), the Partially Observable Markov Decision Proce…

Autonomous VehiclesDecision Making

Autonomous Vehicle Decision-Making Framework for Considering Malicious Behavior at Unsignalized Intersections

2024-09-11 · Qing Li, Jinxing Hua, Qiuxia Sun

In this paper, we propose a Q-learning based decision-making framework to improve the safety and efficiency of Autonomous Vehicles when they encounter other maliciously behaving vehicles while passing through unsignalize…

Autonomous VehiclesDecision MakingQ-Learning

Driving Tasks Transfer in Deep Reinforcement Learning for Decision-making of Autonomous Vehicles

2020-09-07 · Hong Shu, Teng Liu, Xingyu Mu, Dongpu Cao

Knowledge transfer is a promising concept to achieve real-time decision-making for autonomous vehicles. This paper constructs a transfer deep reinforcement learning framework to transform the driving tasks in inter-secti…

Autonomous VehiclesDecision MakingDeep Reinforcement Learningreinforcement-learning+2

Driving Conflict Resolution of Autonomous Vehicles at Unsignalized Intersections: A Differential Game Approach

2022-01-05 · Peng Hang, Chao Huang, Zhongxu Hu, Chen Lv

Considering personalized driving preferences, a new decision-making framework is developed using a differential game approach to resolve the driving conflicts of autonomous vehicles (AVs) at unsignalized intersections. T…

Autonomous VehiclesDecision Making