Semantic Regularization: Improve Few-shot Image Classification by Reducing Meta Shift
Few-shot image classification requires the classifier to robustly cope with unseen classes even if there are only a few samples for each class. Recent advances benefit from the meta-learning process where episodic tasks are formed to train a model that can adapt to class change. However, these task sare independent to each other and existing works mainly rely on limited samples of individual support set in a single meta task. This strategy leads to severe meta shift issues across multiple tasks, meaning the learned prototypes or class descriptors are not stable as each task only involves their own support set. To avoid this problem, we propose a concise Semantic RegularizationNetwork to learn a common semantic space under the framework of meta-learning. In this space, all class descriptors can be regularized by the learned semantic basis, which can effectively solve the meta shift problem. The key is to train a class encoder and decoder structure that can encode the sample embedding features into the semantic domain with trained semantic basis, and generate a more stable and general class descriptor from the decoder. We evaluate our work by extensive comparisons with previous methods on three benchmark datasets (MiniImageNet, TieredImageNet, and CUB). The results show that the semantic regularization module improves performance by 4%-7% over the baseline method, and achieves competitive results over the current state-of-the-art models.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderFew-Shot Image ClassificationGeneral Classificationimage-classificationImage ClassificationMeta-LearningSimilar Papers 제목 키워드 기반
Cross Knowledge-based Generative Zero-Shot Learning Approach with Taxonomy Regularization
Although zero-shot learning (ZSL) has an inferential capability of recognizing new classes that have never been seen before, it always faces two fundamental challenges of the cross modality and crossdomain challenges. In…
image-classificationImage ClassificationRetrievalZero-Shot LearningTowards Robust Few-Shot Text Classification Using Transformer Architectures and Dual Loss Strategies
Few-shot text classification has important application value in low-resource environments. This paper proposes a strategy that combines adaptive fine-tuning, contrastive learning, and regularization optimization to impro…
ClassificationContrastive LearningFew-Shot Text Classificationtext-classification+1Boosted Zero-Shot Learning with Semantic Correlation Regularization
We study zero-shot learning (ZSL) as a transfer learning problem, and focus on the two key aspects of ZSL, model effectiveness and model adaptation. For effective modeling, we adopt the boosting strategy to learn a zero-…
Model SelectionTransfer Learningzero-shot-classificationZero-Shot LearningCIBR: Cross-modal Information Bottleneck Regularization for Robust CLIP Generalization
Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success in cross-modal tasks such as zero-shot image classification and text-image retrieval by effectively aligning visual and textual representation…
Contrastive Learningimage-classificationImage ClassificationImage Retrieval+5Adaptive Semantic Consistency for Cross-domain Few-shot Classification
Cross-domain few-shot classification (CD-FSC) aims to identify novel target classes with a few samples, assuming that there exists a domain shift between source and target domains. Existing state-of-the-art practices typ…
ClassificationCross-Domain Few-Shot