Discovering Avoidable Planner Failures of Autonomous Vehicles using Counterfactual Analysis in Behaviorally Diverse Simulation
Automated Vehicles require exhaustive testing in simulation to detect as many safety-critical failures as possible before deployment on public roads. In this work, we focus on the core decision-making component of autonomous robots: their planning algorithm. We introduce a planner testing framework that leverages recent progress in simulating behaviorally diverse traffic participants. Using large scale search, we generate, detect, and characterize dynamic scenarios leading to collisions. In particular, we propose methods to distinguish between unavoidable and avoidable accidents, focusing especially on automatically finding planner-specific defects that must be corrected before deployment. Through experiments in complex multi-agent intersection scenarios, we show that our method can indeed find a wide range of critical planner failures.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclescounterfactualDecision MakingSimilar Papers 제목 키워드 기반
Long-Tail Prediction Uncertainty Aware Trajectory Planning for Self-driving Vehicles
A typical trajectory planner of autonomous driving commonly relies on predicting the future behavior of surrounding obstacles. Recently, deep learning technology has been widely adopted to design prediction models due to…
Autonomous DrivingAutonomous VehiclesPredictionTrajectory PlanningLearning Responsibility-Attributed Adversarial Scenarios for Testing Autonomous Vehicles
Establishing trustworthy safety assurance for autonomous driving systems (ADSs) requires evidence that failures arise from avoidable system deficiencies rather than unavoidable traffic conflicts. Current adversarial simu…
Autonomous VehiclesAutonomous DrivingValidity Learning on Failures: Mitigating the Distribution Shift in Autonomous Vehicle Planning
The planning problem constitutes a fundamental aspect of the autonomous driving framework. Recent strides in representation learning have empowered vehicles to comprehend their surrounding environments, thereby facilitat…
Autonomous DrivingBench2DriveImitation LearningRepresentation Learning+1DriveSafer: End-to-End Autonomous Driving with Safety Guidance
End-to-End (E2E) autonomous driving models have shown growing capability in recent years, with performance improving on increasingly challenging benchmarks. However, modern generative E2E planners still suffer from a sub…
Autonomous DrivingRisk of Cascading Collisions in Network of Vehicles with Delayed Communication
This paper establishes and explores a framework to analyze the risk of cascading failures in a platoon of autonomous vehicles, accounting for communication time-delays and input uncertainty. Our proposed framework yields…
Autonomous Vehicles