R-TOD: Real-Time Object Detector with Minimized End-to-End Delay for Autonomous Driving
For realizing safe autonomous driving, the end-to-end delays of real-time object detection systems should be thoroughly analyzed and minimized. However, despite recent development of neural networks with minimized inference delays, surprisingly little attention has been paid to their end-to-end delays from an object's appearance until its detection is reported. With this motivation, this paper aims to provide more comprehensive understanding of the end-to-end delay, through which precise best- and worst-case delay predictions are formulated, and three optimization methods are implemented: (i) on-demand capture, (ii) zero-slack pipeline, and (iii) contention-free pipeline. Our experimental results show a 76% reduction in the end-to-end delay of Darknet YOLO (You Only Look Once) v3 (from 1070 ms to 261 ms), thereby demonstrating the great potential of exploiting the end-to-end delay analysis for autonomous driving. Furthermore, as we only modify the system architecture and do not change the neural network architecture itself, our approach incurs no penalty on the detection accuracy.
Code (2)
Tasks
Autonomous Drivingobject-detectionObject DetectionReal-Time Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Minimum Delay Object Detection From Video
We consider the problem of detecting objects, as they come into view, from videos in an online fashion. We provide the first real-time solution that is guaranteed to minimize the delay, i.e., the time between when the ob…
Objectobject-detectionObject DetectionOn the Interaction Between Deep Detectors and Siamese Trackers in Video Surveillance
Visual object tracking is an important function in many real-time video surveillance applications, such as localization and spatio-temporal recognition of persons. In real-world applications, an object detector and track…
Change DetectionObjectObject TrackingVisual Object TrackingCorrDiff: Adaptive Delay-aware Detector with Temporal Cue Inputs for Real-time Object Detection
Real-time object detection takes an essential part in the decision-making process of numerous real-world applications, including collision avoidance and path planning in autonomous driving systems. This paper presents a …
Autonomous DrivingCollision AvoidanceMotion Estimationobject-detection+2MTD: Multi-Timestep Detector for Delayed Streaming Perception
Autonomous driving systems require real-time environmental perception to ensure user safety and experience. Streaming perception is a task of reporting the current state of the world, which is used to evaluate the delay …
Autonomous DrivingFuture predictionA Delay Metric for Video Object Detection: What Average Precision Fails to Tell
Average precision (AP) is a widely used metric to evaluate detection accuracy of image and video object detectors. In this paper, we analyze object detection from videos and point out that AP alone is not sufficient to c…
Objectobject-detectionObject DetectionVideo Object Detection