Shifting Weights: Adapting Object Detectors from Image to Video
Typical object detectors trained on images perform poorly on video, as there is a clear distinction in domain between the two types of data. In this paper, we tackle the problem of adapting object detectors learned from images to work well on videos. We treat the problem as one of unsupervised domain adaptation, in which we are given labeled data from the source domain (image), but only unlabeled data from the target domain (video). Our approach, self-paced domain adaptation, seeks to iteratively adapt the detector by re-training the detector with automatically discovered target domain examples, starting with the easiest first. At each iteration, the algorithm adapts by considering an increased number of target domain examples, and a decreased number of source domain examples. To discover target domain examples from the vast amount of video data, we introduce a simple, robust approach that scores trajectory tracks instead of bounding boxes. We also show how rich and expressive features specific to the target domain can be incorporated under the same framework. We show promising results on the 2011 TRECVID Multimedia Event Detection and LabelMe Video datasets that illustrate the benefit of our approach to adapt object detectors to video.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationEvent DetectionObjectUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Understanding the Effects of Pre-Training for Object Detectors via Eigenspectrum
ImageNet pre-training has been regarded as essential for training accurate object detectors for a long time. Recently, it has been shown that object detectors trained from randomly initialized weights can be on par with …
image-classificationImage ClassificationObjectobject-detection+1I3Net: Implicit Instance-Invariant Network for Adapting One-Stage Object Detectors
Recent works on two-stage cross-domain detection have widely explored the local feature patterns to achieve more accurate adaptation results. These methods heavily rely on the region proposal mechanisms and ROI-based ins…
Region ProposalEvading DeepFake Detectors via Adversarial Statistical Consistency
In recent years, as various realistic face forgery techniques known as DeepFake improves by leaps and bounds,more and more DeepFake detection techniques have been proposed. These methods typically rely on detecting stati…
DeepFake DetectionFace SwappingFrom COCO to COCO-FP: A Deep Dive into Background False Positives for COCO Detectors
Reducing false positives is essential for enhancing object detector performance, as reflected in the mean Average Precision (mAP) metric. Although object detectors have achieved notable improvements and high mAP scores o…
ObjectCenterNet Heatmap Propagation for Real-time Video Object Detection
The existing methods for video object detection mainly depend on two-stage image object detectors. The fact that two-stage detectors are generally slow makes it difficult to apply in real-time scenarios. Moreover, adapti…
Objectobject-detectionObject DetectionVideo Object Detection