Object-aware Feature Aggregation for Video Object Detection
We present an Object-aware Feature Aggregation (OFA) module for video object detection (VID). Our approach is motivated by the intriguing property that video-level object-aware knowledge can be employed as a powerful semantic prior to help object recognition. As a consequence, augmenting features with such prior knowledge can effectively improve the classification and localization performance. To make features get access to more content about the whole video, we first capture the object-aware knowledge of proposals and incorporate such knowledge with the well-established pair-wise contexts. With extensive experimental results on the ImageNet VID dataset, our approach demonstrates the effectiveness of object-aware knowledge with the superior performance of 83.93% and 86.09% mAP with ResNet-101 and ResNeXt-101, respectively. When further equipped with Sequence DIoU NMS, we obtain the best-reported mAP of 85.07% and 86.88% upon the paper submitted. The code to reproduce our results will be released after acceptance.
Code (0)
등록된 구현이 없습니다.
Tasks
Objectobject-detectionObject DetectionObject RecognitionVideo Object DetectionSimilar Papers 제목 키워드 기반
Object-aware Aggregation with Bidirectional Temporal Graph for Video Captioning
Video captioning aims to automatically generate natural language descriptions of video content, which has drawn a lot of attention recent years. Generating accurate and fine-grained captions needs to not only understand …
ObjectVideo CaptioningDAFA: Diversity-Aware Feature Aggregation for Attention-Based Video Object Detection
We present a framework for attention-based video object detection using a simple yet effective external memory management algorithm. An attention mechanism has been adopted in video object detection task to enrich the fe…
DiversityManagementobject-detectionObject Detection+1Flow-Guided Feature Aggregation for Video Object Detection
Extending state-of-the-art object detectors from image to video is challenging. The accuracy of detection suffers from degenerated object appearances in videos, e.g., motion blur, video defocus, rare poses, etc. Existing…
Objectobject-detectionObject DetectionVideo Object Detection+1DFA: Dynamic Feature Aggregation for Efficient Video Object Detection
Video object detection is a fundamental yet challenging task in computer vision. One practical solution is to take advantage of temporal information from the video and apply feature aggregation to enhance the object feat…
Objectobject-detectionObject DetectionVideo Object DetectionShort-Term and Long-Term Context Aggregation Network for Video Inpainting
Video inpainting aims to restore missing regions of a video and has many applications such as video editing and object removal. However, existing methods either suffer from inaccurate short-term context aggregation or ra…
Video EditingVideo Inpainting