Leveraging the Feature Distribution in Transfer-based Few-Shot Learning
Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed to solve few-shot classification, among which transfer-based methods have proved to achieve the best performance. Following this vein, in this paper we propose a novel transfer-based method that builds on two successive steps: 1) preprocessing the feature vectors so that they become closer to Gaussian-like distributions, and 2) leveraging this preprocessing using an optimal-transport inspired algorithm (in the case of transductive settings). Using standardized vision benchmarks, we prove the ability of the proposed methodology to achieve state-of-the-art accuracy with various datasets, backbone architectures and few-shot settings.
Code (6)
Tasks
Few-Shot Image ClassificationFew-Shot LearningGeneral ClassificationSimilar Papers 제목 키워드 기반
Two-Level Adversarial Visual-Semantic Coupling for Generalized Zero-shot Learning
The performance of generative zero-shot methods mainly depends on the quality of generated features and how well the model facilitates knowledge transfer between visual and semantic domains. The quality of generated feat…
Generalized Zero-Shot LearningRepresentation LearningTransfer LearningVocal Bursts Valence Prediction+1Attribute Distribution Modeling and Semantic-Visual Alignment for Generative Zero-shot Learning
Generative zero-shot learning (ZSL) synthesizes features for unseen classes, leveraging semantic conditions to transfer knowledge from seen classes. However, it also introduces two intrinsic challenges: (1) class-level a…
Zero-Shot LearningA Model of Two Tales: Dual Transfer Learning Framework for Improved Long-tail Item Recommendation
Highly skewed long-tail item distribution is very common in recommendation systems. It significantly hurts model performance on tail items. To improve tail-item recommendation, we conduct research to transfer knowledge f…
Data AugmentationRecommendation SystemsRepresentation LearningTransfer LearningTransfer Learning for Power Outage Detection Task with Limited Training Data
Early detection of power outages is crucial for maintaining a reliable power distribution system. This research investigates the use of transfer learning and language models in detecting outages with limited labeled data…
Few-Shot LearningTransfer LearningBoosting Few-Shot Text Classification via Distribution Estimation
Distribution estimation has been demonstrated as one of the most effective approaches in dealing with few-shot image classification, as the low-level patterns and underlying representations can be easily transferred acro…
ClassificationFew-Shot Image ClassificationFew-Shot Text Classificationimage-classification+3