A novel framework for adaptive stress testing of autonomous vehicles in highways
Guaranteeing the safe operations of autonomous vehicles (AVs) is crucial for their widespread adoption and public acceptance. It is thus of a great significance to not only assess the AV against the standard safety tests, but also discover potential corner cases of the AV under test that could lead to unsafe behaviour or scenario. In this paper, we propose a novel framework to systematically explore corner cases that can result in safety concerns in a highway traffic scenario. The framework is based on an adaptive stress testing (AST) approach, an emerging validation method that leverages a Markov decision process to formulate the scenarios and deep reinforcement learning (DRL) to discover the desirable patterns representing corner cases. To this end, we develop a new reward function for DRL to guide the AST in identifying crash scenarios based on the collision probability estimate between the AV under test (i.e., the ego vehicle) and the trajectory of other vehicles on the highway. The proposed framework is further integrated with a new driving model enabling us to create more realistic traffic scenarios capturing both the longitudinal and lateral movements of vehicles on the highway. In our experiment, we calibrate our model using real-world crash statistics involving automated vehicles in California, and then we analyze the characteristics of the AV and the framework. Quantitative and qualitative analyses of our experimental results demonstrate that our framework outperforms other existing AST schemes. The study can help discover crash scenarios of AV that are unknown or absent in human driving, thereby enhancing the safety and trustworthiness of AV technology.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesDeep Reinforcement LearningSimilar Papers 제목 키워드 기반
Adaptive Stress Testing for Autonomous Vehicles
This paper presents a method for testing the decision making systems of autonomous vehicles. Our approach involves perturbing stochastic elements in the vehicle's environment until the vehicle is involved in a collision.…
Autonomous VehiclesDecision MakingDeep Reinforcement Learningreinforcement-learning+2Adaptive Failure Search Using Critical States from Domain Experts
Uncovering potential failure cases is a crucial step in the validation of safety critical systems such as autonomous vehicles. Failure search may be done through logging substantial vehicle miles in either simulation or …
Autonomous DrivingAutonomous VehiclesFinding Failures in High-Fidelity Simulation using Adaptive Stress Testing and the Backward Algorithm
Validating the safety of autonomous systems generally requires the use of high-fidelity simulators that adequately capture the variability of real-world scenarios. However, it is generally not feasible to exhaustively se…
Autonomous VehiclesDeep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Adaptive Stress Testing with Reward Augmentation for Autonomous Vehicle Validation
Determining possible failure scenarios is a critical step in the evaluation of autonomous vehicle systems. Real-world vehicle testing is commonly employed for autonomous vehicle validation, but the costs and time require…
Reinforcement LearningAdaptive Stress Testing: Finding Likely Failure Events with Reinforcement Learning
Finding the most likely path to a set of failure states is important to the analysis of safety-critical systems that operate over a sequence of time steps, such as aircraft collision avoidance systems and autonomous cars…
Autonomous DrivingCollision Avoidancereinforcement-learningReinforcement Learning+1