Tactical Decision-Making in Autonomous Driving by Reinforcement Learning with Uncertainty Estimation

2020-04-22 · Carl-Johan Hoel, Krister Wolff, Leo Laine

Reinforcement learning (RL) can be used to create a tactical decision-making agent for autonomous driving. However, previous approaches only output decisions and do not provide information about the agent's confidence in the recommended actions. This paper investigates how a Bayesian RL technique, based on an ensemble of neural networks with additional randomized prior functions (RPF), can be used to estimate the uncertainty of decisions in autonomous driving. A method for classifying whether or not an action should be considered safe is also introduced. The performance of the ensemble RPF method is evaluated by training an agent on a highway driving scenario. It is shown that the trained agent can estimate the uncertainty of its decisions and indicate an unacceptable level when the agent faces a situation that is far from the training distribution. Furthermore, within the training distribution, the ensemble RPF agent outperforms a standard Deep Q-Network agent. In this study, the estimated uncertainty is used to choose safe actions in unknown situations. However, the uncertainty information could also be used to identify situations that should be added to the training process.

📄 PDF Abstract BibTeX arXiv:2004.10439

Code (1)

carljohanhoel/BayesianRLForAutonomousDriving 공식 구현

Tasks

Autonomous Driving Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving

2019-05-06 · Carl-Johan Hoel, Katherine Driggs-Campbell, Krister Wolff, Leo Laine 외

Tactical decision making for autonomous driving is challenging due to the diversity of environments, the uncertainty in the sensor information, and the complex interaction with other road users. This paper introduces a g…

Autonomous Driving Decision Making Deep Reinforcement Learning Diversity+2

Elements of Effective Deep Reinforcement Learning towards Tactical Driving Decision Making

2018-02-01 · Jingchu Liu, Pengfei Hou, Lisen Mu, Yinan Yu 외

Tactical driving decision making is crucial for autonomous driving systems and has attracted considerable interest in recent years. In this paper, we propose several practical components that can speed up deep reinforcem…

Autonomous Driving Decision Making Deep Reinforcement Learning reinforcement-learning+2

Reinforcement Learning Based Safe Decision Making for Highway Autonomous Driving

2021-05-13 · Arash Mohammadhasani, Hamed Mehrivash, Alan Lynch, Zhan Shu

In this paper, we develop a safe decision-making method for self-driving cars in a multi-lane, single-agent setting. The proposed approach utilizes deep reinforcement learning (RL) to achieve a high-level policy for safe…

Autonomous Driving Autonomous Navigation Decision Making Deep Reinforcement Learning+4

Multi-Objective Reinforcement Learning for Tactical Decision Making for Trucks in Highway Traffic

2026-01-26 · Deepthi Pathare, Leo Laine, Morteza Haghir Chehreghani arxiv

Balancing safety, efficiency, and operational costs in highway driving poses a challenging decision-making problem for heavy-duty vehicles. A central difficulty is that conventional scalar reward formulations, obtained b…

Reinforcement Learning Decision Making

A Hierarchical Architecture for Sequential Decision-Making in Autonomous Driving using Deep Reinforcement Learning

2019-06-20 · Majid Moghadam, Gabriel Hugh Elkaim

Tactical decision making is a critical feature for advanced driving systems, that incorporates several challenges such as complexity of the uncertain environment and reliability of the autonomous system. In this work, we…

Autonomous Driving Decision Making Deep Reinforcement Learning Reinforcement Learning+3