Prototypical Region Proposal Networks for Few-Shot Localization and Classification
Recently proposed few-shot image classification methods have generally focused on use cases where the objects to be classified are the central subject of images. Despite success on benchmark vision datasets aligned with this use case, these methods typically fail on use cases involving densely-annotated, busy images: images common in the wild where objects of relevance are not the central subject, instead appearing potentially occluded, small, or among other incidental objects belonging to other classes of potential interest. To localize relevant objects, we employ a prototype-based few-shot segmentation model which compares the encoded features of unlabeled query images with support class centroids to produce region proposals indicating the presence and location of support set classes in a query image. These region proposals are then used as additional conditioning input to few-shot image classifiers. We develop a framework to unify the two stages (segmentation and classification) into an end-to-end classification model -- PRoPnet -- and empirically demonstrate that our methods improve accuracy on image datasets with natural scenes containing multiple object classes.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFew-Shot Image ClassificationGeneral Classificationimage-classificationImage ClassificationRegion ProposalSimilar Papers 제목 키워드 기반
Gaussian Prototypical Networks for Few-Shot Learning on Omniglot
We propose a novel architecture for $k$-shot classification on the Omniglot dataset. Building on prototypical networks, we extend their architecture to what we call Gaussian prototypical networks. Prototypical networks l…
ClassificationClusteringFew-Shot LearningGeneral ClassificationLocation-Aware Box Reasoning for Anchor-Based Single-Shot Object Detection
In the majority of object detection frameworks, the confidence of instance classification is used as the quality criterion of predicted bounding boxes, like the confidence-based ranking in non-maximum suppression (NMS). …
General ClassificationObjectobject-detectionObject Detection+1Object-Extent Pooling for Weakly Supervised Single-Shot Localization
In the face of scarcity in detailed training annotations, the ability to perform object localization tasks in real-time with weak-supervision is very valuable. However, the computational cost of generating and evaluating…
ObjectObject LocalizationRegion ProposalWeakly-Supervised Object LocalizationFast Fine-grained Image Classification via Weakly Supervised Discriminative Localization
Fine-grained image classification is to recognize hundreds of subcategories in each basic-level category. Existing methods employ discriminative localization to find the key distinctions among subcategories. However, the…
ClassificationFine-Grained Image ClassificationGeneral Classificationimage-classification+2ProCal: Inference-Time Proposal Calibration for Open-Vocabulary Object Detection
Open-vocabulary object detection aims to localize and classify objects beyond the fixed set of categories seen dur ing training. Recent open-vocabulary object detection methods improve localization and classification for…
Object Detection