Breaking Immutable: Information-Coupled Prototype Elaboration for Few-Shot Object Detection
Few-shot object detection, expecting detectors to detect novel classes with a few instances, has made conspicuous progress. However, the prototypes extracted by existing meta-learning based methods still suffer from insufficient representative information and lack awareness of query images, which cannot be adaptively tailored to different query images. Firstly, only the support images are involved for extracting prototypes, resulting in scarce perceptual information of query images. Secondly, all pixels of all support images are treated equally when aggregating features into prototype vectors, thus the salient objects are overwhelmed by the cluttered background. In this paper, we propose an Information-Coupled Prototype Elaboration (ICPE) method to generate specific and representative prototypes for each query image. Concretely, a conditional information coupling module is introduced to couple information from the query branch to the support branch, strengthening the query-perceptual information in support features. Besides, we design a prototype dynamic aggregation module that dynamically adjusts intra-image and inter-image aggregation weights to highlight the salient information useful for detecting query images. Experimental results on both Pascal VOC and MS COCO demonstrate that our method achieves state-of-the-art performance in almost all settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Object DetectionMeta-Learningobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Private Counterfactual Retrieval With Immutable Features
In a classification task, counterfactual explanations provide the minimum change needed for an input to be classified into a favorable class. We consider the problem of privately retrieving the exact closest counterfactu…
counterfactualInformation RetrievalRetrievalElaborative Simplification as Implicit Questions Under Discussion
Automated text simplification, a technique useful for making text more accessible to people such as children and emergent bilinguals, is often thought of as a monolingual translation task from complex sentences to simpli…
DecoderQuestion GenerationQuestion-GenerationText Simplifications-Adaptive Decoupled Prototype for Few-Shot Object Detection
Meta-learning-based few-shot detectors use one K-average-pooled prototype (averaging along K-shot dimension) in both Region Proposal Network (RPN) and Detection head (DH) for query detection. Such plain operation wou…
Few-Shot Object DetectionMeta-LearningObjectobject-detection+2Prototype-Based Information Compensation Network for Multi-Source Remote Sensing Data Classification
Multi-source remote sensing data joint classification aims to provide accuracy and reliability of land cover classification by leveraging the complementary information from multiple data sources. Existing methods confron…
Land Cover ClassificationFoot In The Door: Understanding Large Language Model Jailbreaking via Cognitive Psychology
Large Language Models (LLMs) have gradually become the gateway for people to acquire new knowledge. However, attackers can break the model's security protection ("jail") to access restricted information, which is called …
Decision MakingLanguage ModelingLanguage ModellingLarge Language Model