An evaluation metric for object detection algorithms in autonomous navigation systems and its application to a real-time alerting system
An autonomous navigation system relies on a number of sensors including radar, LIDAR and a visible light camera for its operation. We focus our attention on the visible light camera in this work. Object detection is the key first step to processing the video input from the camera. Specifically, we address the problem of assessing the performance of object detection algorithms in hazardous driving conditions that an autonomous navigation system is expected to encounter in a realistic scenario. To this end, we propose a novel metric for quantifying the degradation in performance of an object detection algorithm under different weather conditions. Additionally' we introduce a real-time method to detect extreme variations in performance of the algorithm that can be used to issue an alert. We evaluate the performance of our metric and alerting system and demonstrate its utility using the YOLOv2 object detection algorithm trained on the KITTI and virtual KITTI dataset.
Code (1)
Tasks
Autonomous NavigationObjectobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Quality Index Metric and Method for Online Self-Assessment of Autonomous Vehicles Sensory Perception
Reliable object detection using cameras plays a crucial role in enabling autonomous vehicles to perceive their surroundings. However, existing camera-based object detection approaches for autonomous driving lack the abil…
Autonomous DrivingAutonomous VehiclesObjectobject-detection+3Investigating the Impact of Multi-LiDAR Placement on Object Detection for Autonomous Driving
The past few years have witnessed an increasing interest in improving the perception performance of LiDARs on autonomous vehicles. While most of the existing works focus on developing new deep learning algorithms or mode…
3D Object DetectionAutonomous DrivingAutonomous VehiclesObject+2Risk Ranked Recall: Collision Safety Metric for Object Detection Systems in Autonomous Vehicles
Commonly used metrics for evaluation of object detection systems (precision, recall, mAP) do not give complete information about their suitability of use in safety critical tasks, like obstacle detection for collision av…
Autonomous VehiclesCollision AvoidanceObjectobject-detection+1LSM: A Comprehensive Metric for Assessing the Safety of Lane Detection Systems in Autonomous Driving
Comprehensive perception of the vehicle's environment and correct interpretation of the environment are crucial for the safe operation of autonomous vehicles. The perception of surrounding objects is the main component f…
Autonomous DrivingAutonomous VehiclesLane DetectionObject+3A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving
Capturing uncertainty in object detection is indispensable for safe autonomous driving. In recent years, deep learning has become the de-facto approach for object detection, and many probabilistic object detectors have b…
Autonomous DrivingObjectobject-detectionObject Detection