Meta-DETR: Image-Level Few-Shot Object Detection with Inter-Class Correlation Exploitation
Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is constrained by several factors, such as (i) low-quality region proposals for novel classes and (ii) negligence of the inter-class correlation among different classes. Such limitations hinder the generalization of base-class knowledge for the detection of novel-class objects. In this work, we design Meta-DETR, a novel few-shot detection framework that incorporates correlational aggregation for meta-learning into DETR detection frameworks. Meta-DETR works entirely at image level without any region proposals, which circumvents the constraint of inaccurate proposals in prevalent few-shot detection frameworks. Besides, Meta-DETR can simultaneously attend to multiple support classes within a single feed-forward. This unique design allows capturing the inter-class correlation among different classes, which significantly reduces the misclassification of similar classes and enhances knowledge generalization to novel classes. Experiments over multiple few-shot object detection benchmarks show that the proposed Meta-DETR outperforms state-of-the-art methods by large margins. The implementation codes will be released at https://github.com/ZhangGongjie/Meta-DETR.
Code (2)
Tasks
Few-Shot Object DetectionMeta-Learningobject-detectionObject DetectionObject LocalizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Meta-DETR: Image-Level Few-Shot Detection with Inter-Class Correlation Exploitation
Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is still constrained by several factors, such as (…
Few-Shot Object DetectionMeta-LearningObjectobject-detection+1Meta-ZSDETR: Zero-shot DETR with Meta-learning
Zero-shot object detection aims to localize and recognize objects of unseen classes. Most of existing works face two problems: the low recall of RPN in unseen classes and the confusion of unseen classes with background. …
Contrastive LearningMeta-Learningobject-detectionObject Detection+1UP-DETR: Unsupervised Pre-training for Object Detection with Transformers
DEtection TRansformer (DETR) for object detection reaches competitive performance compared with Faster R-CNN via a transformer encoder-decoder architecture. However, trained with scratch transformers, DETR needs large-sc…
DecoderMulti-Task Learningobject-detectionObject Detection+2Decoupled DETR For Few-shot Object Detection
Few-shot object detection (FSOD), an efficient method for addressing the severe data-hungry problem, has been extensively discussed. Current works have significantly advanced the problem in terms of model and data. Howev…
DecoderFew-Shot Object DetectionMeta-LearningObject+2OVA-DETR: Open Vocabulary Aerial Object Detection Using Image-Text Alignment and Fusion
Aerial object detection has been a hot topic for many years due to its wide application requirements. However, most existing approaches can only handle predefined categories, which limits their applicability for the open…
Decoderobject-detectionObject Detection