Few-Shot Video Object Detection
We introduce Few-Shot Video Object Detection (FSVOD) with three contributions to real-world visual learning challenge in our highly diverse and dynamic world: 1) a large-scale video dataset FSVOD-500 comprising of 500 classes with class-balanced videos in each category for few-shot learning; 2) a novel Tube Proposal Network (TPN) to generate high-quality video tube proposals for aggregating feature representation for the target video object which can be highly dynamic; 3) a strategically improved Temporal Matching Network (TMN+) for matching representative query tube features with better discriminative ability thus achieving higher diversity. Our TPN and TMN+ are jointly and end-to-end trained. Extensive experiments demonstrate that our method produces significantly better detection results on two few-shot video object detection datasets compared to image-based methods and other naive video-based extensions. Codes and datasets are released at \url{https://github.com/fanq15/FewX}.
Code (1)
Tasks
DiversityFew-Shot LearningFew-Shot Video Object DetectionObjectobject-detectionObject DetectionVideo Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
When Few-Shot Learning Meets Video Object Detection
Different from static images, videos contain additional temporal and spatial information for better object detection. However, it is costly to obtain a large number of videos with bounding box annotations that are requir…
Few-Shot LearningFew-Shot Video Object DetectionObjectobject-detection+3Temporal Object-Aware Vision Transformer for Few-Shot Video Object Detection
Few-shot Video Object Detection (FSVOD) addresses the challenge of detecting novel objects in videos with limited labeled examples, overcoming the constraints of traditional detection methods that require extensive train…
Video Object DetectionComplex Event Detection by Identifying Reliable Shots From Untrimmed Videos
The goal of complex event detection is to automatically detect whether an event of interest happens in temporally untrimmed long videos which usually consist of multiple video shots. Observing some video shots in positiv…
Event DetectionShot boundary detection method based on a new extensive dataset and mixed features
Shot boundary detection in video is one of the key stages of video data processing. A new method for shot boundary detection based on several video features, such as color histograms and object boundaries, has been propo…
Boundary DetectionChange DetectionScene Change DetectionContext in object detection: a systematic literature review
Context is an important factor in computer vision as it offers valuable information to clarify and analyze visual data. Utilizing the contextual information inherent in an image or a video can improve the precision and e…
Few-Shot Object DetectionObjectobject-detectionObject Detection+4