Boosting Few-Shot Visual Learning with Self-Supervision
Few-shot learning and self-supervised learning address different facets of the same problem: how to train a model with little or no labeled data. Few-shot learning aims for optimization methods and models that can learn efficiently to recognize patterns in the low data regime. Self-supervised learning focuses instead on unlabeled data and looks into it for the supervisory signal to feed high capacity deep neural networks. In this work we exploit the complementarity of these two domains and propose an approach for improving few-shot learning through self-supervision. We use self-supervision as an auxiliary task in a few-shot learning pipeline, enabling feature extractors to learn richer and more transferable visual representations while still using few annotated samples. Through self-supervision, our approach can be naturally extended towards using diverse unlabeled data from other datasets in the few-shot setting. We report consistent improvements across an array of architectures, datasets and self-supervision techniques.
Code (1)
Tasks
Few-Shot LearningSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Boosting Supervision with Self-Supervision for Few-shot Learning
We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervise…
Few-Shot LearningSelf-Supervised LearningSLIP: Self-supervision meets Language-Image Pre-training
Recent work has shown that self-supervised pre-training leads to improvements over supervised learning on challenging visual recognition tasks. CLIP, an exciting new approach to learning with language supervision, demons…
Multi-Task LearningRepresentation LearningSelf-Supervised LearningUni-Mlip: Unified Self-supervision for Medical Vision Language Pre-training
Recent advancements in vision-language pre-training via contrastive learning have significantly improved performance across computer vision tasks. However, in the medical domain, obtaining multimodal data is often costly…
Contrastive Learningimage-classificationImage ClassificationImage-text Retrieval+5Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learning
This paper introduces a new concept called "transferable visual words" (TransVW), aiming to achieve annotation efficiency for deep learning in medical image analysis. Medical imaging--focusing on particular parts of the …
AnatomyMedical Image AnalysisMedical Image SegmentationSelf-Supervised Learning+1Visual Representation Learning with Self-Supervised Attention for Low-Label High-data Regime
Self-supervision has shown outstanding results for natural language processing, and more recently, for image recognition. Simultaneously, vision transformers and its variants have emerged as a promising and scalable alte…
Few-Shot Image Classificationimage-classificationImage ClassificationImage Retrieval+4