paper-with-me

홈 › Papers

Run-time Introspection of 2D Object Detection in Automated Driving Systems Using Learning Representations

2024-03-02 · Hakan Yekta Yatbaz, Mehrdad Dianati, Konstantinos Koufos, Roger Woodman

Reliable detection of various objects and road users in the surrounding environment is crucial for the safe operation of automated driving systems (ADS). Despite recent progresses in developing highly accurate object detectors based on Deep Neural Networks (DNNs), they still remain prone to detection errors, which can lead to fatal consequences in safety-critical applications such as ADS. An effective remedy to this problem is to equip the system with run-time monitoring, named as introspection in the context of autonomous systems. Motivated by this, we introduce a novel introspection solution, which operates at the frame level for DNN-based 2D object detection and leverages neural network activation patterns. The proposed approach pre-processes the neural activation patterns of the object detector's backbone using several different modes. To provide extensive comparative analysis and fair comparison, we also adapt and implement several state-of-the-art (SOTA) introspection mechanisms for error detection in 2D object detection, using one-stage and two-stage object detectors evaluated on KITTI and BDD datasets. We compare the performance of the proposed solution in terms of error detection, adaptability to dataset shift, and, computational and memory resource requirements. Our performance evaluation shows that the proposed introspection solution outperforms SOTA methods, achieving an absolute reduction in the missed error ratio of 9% to 17% in the BDD dataset.

📄 PDF Abstract BibTeX arXiv:2403.01172

Code (0)

등록된 구현이 없습니다.

Tasks

2D Object DetectionObjectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

LFA: Layer Feature Attention for Run-Time Introspection of 2D Object Detectors in Automated Driving

2026-05-29 · Mert Keser, Alois Knoll arxiv

Reliable object detection is critical for automated driving, yet even state-of-the-art detectors inevitably make errors that can compromise safety. Introspection methods that predict detector failures enable safer deploy…

Scene UnderstandingObject Detection

Integrity Monitoring of 3D Object Detection in Automated Driving Systems using Raw Activation Patterns and Spatial Filtering

2024-05-13 · Hakan Yekta Yatbaz, Mehrdad Dianati, Konstantinos Koufos, Roger Woodman

The deep neural network (DNN) models are widely used for object detection in automated driving systems (ADS). Yet, such models are prone to errors which can have serious safety implications. Introspection and self-assess…

3D Object Detectionobject-detectionObject Detection

Run-time Monitoring of 3D Object Detection in Automated Driving Systems Using Early Layer Neural Activation Patterns

2024-04-11 · Hakan Yekta Yatbaz, Mehrdad Dianati, Konstantinos Koufos, Roger Woodman

Monitoring the integrity of object detection for errors within the perception module of automated driving systems (ADS) is paramount for ensuring safety. Despite recent advancements in deep neural network (DNN)-based obj…

2D Object Detection3D Object DetectionObjectobject-detection+1

First qualitative observations on deep learning vision model YOLO and DETR for automated driving in Austria

2023-12-19 · Stefan Schoder

This study investigates the application of single and two-stage 2D-object detection algorithms like You Only Look Once (YOLO), Real-Time DEtection TRansformer (RT-DETR) algorithm for automated object detection to enhance…

2D Object DetectionAutonomous DrivingAutonomous VehiclesObject+3

YOLO3D: End-to-end real-time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud

2018-08-07 · Waleed Ali, Sherif Abdelkarim, Mohamed Zahran, Mahmoud Zidan 외

Object detection and classification in 3D is a key task in Automated Driving (AD). LiDAR sensors are employed to provide the 3D point cloud reconstruction of the surrounding environment, while the task of 3D object bound…

3D Point Cloud ReconstructionGPUObjectobject-detection+3