Efficient One-stage Video Object Detection by Exploiting Temporal Consistency
Recently, one-stage detectors have achieved competitive accuracy and faster speed compared with traditional two-stage detectors on image data. However, in the field of video object detection (VOD), most existing VOD methods are still based on two-stage detectors. Moreover, directly adapting existing VOD methods to one-stage detectors introduces unaffordable computational costs. In this paper, we first analyse the computational bottlenecks of using one-stage detectors for VOD. Based on the analysis, we present a simple yet efficient framework to address the computational bottlenecks and achieve efficient one-stage VOD by exploiting the temporal consistency in video frames. Specifically, our method consists of a location-prior network to filter out background regions and a size-prior network to skip unnecessary computations on low-level feature maps for specific frames. We test our method on various modern one-stage detectors and conduct extensive experiments on the ImageNet VID dataset. Excellent experimental results demonstrate the superior effectiveness, efficiency, and compatibility of our method. The code is available at https://github.com/guanxiongsun/vfe.pytorch.
Code (1)
Tasks
object-detectionObject DetectionVideo Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Modification method for single-stage object detectors that allows to exploit the temporal behaviour of a scene to improve detection accuracy
A simple modification method for single-stage generic object detection neural networks, such as YOLO and SSD, is proposed, which allows for improving the detection accuracy on video data by exploiting the temporal behavi…
object-detectionObject DetectionClusterNet: Detecting Small Objects in Large Scenes by Exploiting Spatio-Temporal Information
Object detection in wide area motion imagery (WAMI) has drawn the attention of the computer vision research community for a number of years. WAMI proposes a number of unique challenges including extremely small object si…
Objectobject-detectionObject DetectionA Proposal-Based Solution to Spatio-Temporal Action Detection in Untrimmed Videos
Existing approaches for spatio-temporal action detection in videos are limited by the spatial extent and temporal duration of the actions. In this paper, we present a modular system for spatio-temporal action detection i…
Action ClassificationAction DetectionClusteringobject-detection+1Deep Convolutional Generative Adversarial Networks Based Flame Detection in Video
Real-time flame detection is crucial in video based surveillance systems. We propose a vision-based method to detect flames using Deep Convolutional Generative Adversarial Neural Networks (DCGANs). Many existing supervis…
Full-Duplex Strategy for Video Object Segmentation
Previous video object segmentation approaches mainly focus on using simplex solutions between appearance and motion, limiting feature collaboration efficiency among and across these two cues. In this work, we study a nov…
ObjectObject DetectionSalient Object DetectionSegmentation+6