Auto-view contrastive learning for few-shot image recognition
Few-shot learning aims to recognize new classes with few annotated instances within each category. Recently, metric-based meta-learning approaches have shown the superior performance in tackling few-shot learning problems. Despite their success, existing metric-based few-shot approaches often fail to push the fine-grained sub-categories apart in the embedding space given no fine-grained labels. This may result in poor generalization to fine-grained sub-categories, and thus affects model interpretation. To alleviate this problem, we introduce contrastive loss into few-shot classification for learning latent fine-grained structure in the embedding space. Furthermore, to overcome the drawbacks of random image transformation used in current contrastive learning in producing noisy and inaccurate image pairs (i.e., views), we develop a learning-to-learn algorithm to automatically generate different views of the same image. Extensive experiments on standard few-shot learning benchmarks and few-shot fine-grained image classification demonstrate the superiority of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningFew-Shot LearningFine-Grained Image ClassificationGeneral Classificationimage-classificationImage ClassificationMeta-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Supervised Contrastive Learning for Accented Speech Recognition
Neural network based speech recognition systems suffer from performance degradation due to accented speech, especially unfamiliar accents. In this paper, we study the supervised contrastive learning framework for accente…
Accented Speech RecognitionContrastive LearningData AugmentationSentence+2Boosting Few-Shot Classification with View-Learnable Contrastive Learning
The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based met…
ClassificationContrastive LearningFew-Shot LearningMeta-LearningLearning View-Disentangled Human Pose Representation by Contrastive Cross-View Mutual Information Maximization
We introduce a novel representation learning method to disentangle pose-dependent as well as view-dependent factors from 2D human poses. The method trains a network using cross-view mutual information maximization (CV-MI…
Action RecognitionContrastive LearningDisentanglementRepresentation LearningUnified Contrastive Learning in Image-Text-Label Space
Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result i…
Contrastive Learningimage-classificationImage ClassificationTransfer Learning+1Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks. However, CLIP…
Zero-Shot Learning