Objects do not disappear: Video object detection by single-frame object location anticipation
Objects in videos are typically characterized by continuous smooth motion. We exploit continuous smooth motion in three ways. 1) Improved accuracy by using object motion as an additional source of supervision, which we obtain by anticipating object locations from a static keyframe. 2) Improved efficiency by only doing the expensive feature computations on a small subset of all frames. Because neighboring video frames are often redundant, we only compute features for a single static keyframe and predict object locations in subsequent frames. 3) Reduced annotation cost, where we only annotate the keyframe and use smooth pseudo-motion between keyframes. We demonstrate computational efficiency, annotation efficiency, and improved mean average precision compared to the state-of-the-art on four datasets: ImageNet VID, EPIC KITCHENS-55, YouTube-BoundingBoxes, and Waymo Open dataset. Our source code is available at https://github.com/L-KID/Videoobject-detection-by-location-anticipation.
Code (2)
Tasks
Computational EfficiencyObjectobject-detectionObject DetectionVideo Object DetectionSimilar Papers 제목 키워드 기반
Physical Adversarial Examples for Object Detectors
Deep neural networks (DNNs) are vulnerable to adversarial examples-maliciously crafted inputs that cause DNNs to make incorrect predictions. Recent work has shown that these attacks generalize to the physical domain, to …
Objectobject-detectionObject DetectionCDTS: Collaborative Detection, Tracking, and Segmentation for Online Multiple Object Segmentation in Videos
A novel online algorithm to segment multiple objects in a video sequence is proposed in this work. We develop the collaborative detection, tracking, and segmentation (CDTS) technique to extract multiple segment tracks ac…
ObjectSegmentationSemantic SegmentationLearning to Track: Online Multi-Object Tracking by Decision Making
Online Multi-Object Tracking (MOT) has wide applications in time-critical video analysis scenarios, such as robot navigation and autonomous driving. In tracking-by-detection, a major challenge of online MOT is how to rob…
Autonomous DrivingDecision MakingMulti-Object TrackingMultiple Object Tracking+5DVIS-DAQ: Improving Video Segmentation via Dynamic Anchor Queries
Modern video segmentation methods adopt object queries to perform inter-frame association and demonstrate satisfactory performance in tracking continuously appearing objects despite large-scale motion and transient occlu…
ObjectVideo Instance SegmentationVideo SegmentationVideo Semantic SegmentationDynamic Atomic Column Detection in Transmission Electron Microscopy Videos via Ridge Estimation
Ridge detection is a classical tool to extract curvilinear features in image processing. As such, it has great promise in applications to material science problems; specifically, for trend filtering relatively stable ato…
Object Recognition