Uncertainty-Aware Few-Shot Image Classification
Few-shot image classification learns to recognize new categories from limited labelled data. Metric learning based approaches have been widely investigated, where a query sample is classified by finding the nearest prototype from the support set based on their feature similarities. A neural network has different uncertainties on its calculated similarities of different pairs. Understanding and modeling the uncertainty on the similarity could promote the exploitation of limited samples in few-shot optimization. In this work, we propose Uncertainty-Aware Few-Shot framework for image classification by modeling uncertainty of the similarities of query-support pairs and performing uncertainty-aware optimization. Particularly, we exploit such uncertainty by converting observed similarities to probabilistic representations and incorporate them to the loss for more effective optimization. In order to jointly consider the similarities between a query and the prototypes in a support set, a graph-based model is utilized to estimate the uncertainty of the pairs. Extensive experiments show our proposed method brings significant improvements on top of a strong baseline and achieves the state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFew-Shot Image ClassificationFew-Shot LearningGeneral Classificationimage-classificationImage ClassificationMetric LearningSimilar Papers 제목 키워드 기반
A$_3$B$_2$: Adaptive Asymmetric Adapter for Alleviating Branch Bias in Vision-Language Image Classification with Few-Shot Learning
Efficient transfer learning methods for large-scale vision-language models ($e.g.$, CLIP) enable strong few-shot transfer, yet existing adaptation methods follow a fixed fine-tuning paradigm that implicitly assumes a uni…
Few-Shot Image ClassificationFew-Shot LearningTransfer LearningActive Learning for Vision-Language Models
Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap betwe…
Active Learningimage-classificationImage Classificationzero-shot-classification+1GP-Adapter: Gaussian Process CLIP-Adapter for Few-Shot Out-of-Distribution Detection
We propose GP-Adapter, a training-free framework that augments CLIP (Contrastive Language-Image Pre-training) with Gaussian Process (GP) uncertainty modeling for few-shot classification and out-of-distribution (OOD) dete…
Out-of-Distribution DetectionMultidimensional Belief Quantification for Label-Efficient Meta-Learning
Optimization-based meta-learning offers a promising direction for few-shot learning that is essential for many real-world computer vision applications. However, learning from few samples introduces uncertainty, and quant…
Few-Shot Image ClassificationFew-Shot Learningimage-classificationImage Classification+1Uncertainty-Aware Semi-Supervised Few Shot Segmentation
Few shot segmentation (FSS) aims to learn pixel-level classification of a target object in a query image using only a few annotated support samples. This is challenging as it requires modeling appearance variations of ta…
Pseudo LabelSegmentation