paper-with-me

Papers

Boosting Few-Shot Visual Learning with Self-Supervision

2019-06-12 · ICCV 2019 10 · Spyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez, Matthieu Cord

Few-shot learning and self-supervised learning address different facets of the same problem: how to train a model with little or no labeled data. Few-shot learning aims for optimization methods and models that can learn efficiently to recognize patterns in the low data regime. Self-supervised learning focuses instead on unlabeled data and looks into it for the supervisory signal to feed high capacity deep neural networks. In this work we exploit the complementarity of these two domains and propose an approach for improving few-shot learning through self-supervision. We use self-supervision as an auxiliary task in a few-shot learning pipeline, enabling feature extractors to learn richer and more transferable visual representations while still using few annotated samples. Through self-supervision, our approach can be naturally extended towards using diverse unlabeled data from other datasets in the few-shot setting. We report consistent improvements across an array of architectures, datasets and self-supervision techniques.

📄 PDF Abstract BibTeX arXiv:1906.05186

Code (1)

valeoai/BF3S 공식 구현 pytorch

Tasks

Few-Shot LearningSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Boosting Supervision with Self-Supervision for Few-shot Learning

2019-06-17 · Jong-Chyi Su, Subhransu Maji, Bharath Hariharan

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervise…

Few-Shot LearningSelf-Supervised Learning

SLIP: Self-supervision meets Language-Image Pre-training

2021-12-23 · Norman Mu, Alexander Kirillov, David Wagner, Saining Xie

Recent work has shown that self-supervised pre-training leads to improvements over supervised learning on challenging visual recognition tasks. CLIP, an exciting new approach to learning with language supervision, demons…

Multi-Task LearningRepresentation LearningSelf-Supervised Learning

Uni-Mlip: Unified Self-supervision for Medical Vision Language Pre-training

2024-11-20 · Ameera Bawazir, Kebin Wu, Wenbin Li

Recent advancements in vision-language pre-training via contrastive learning have significantly improved performance across computer vision tasks. However, in the medical domain, obtaining multimodal data is often costly…

Contrastive Learningimage-classificationImage ClassificationImage-text Retrieval+5

Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learning

2021-02-21 · Fatemeh Haghighi, Mohammad Reza Hosseinzadeh Taher, Zongwei Zhou, Michael B. Gotway 외

This paper introduces a new concept called "transferable visual words" (TransVW), aiming to achieve annotation efficiency for deep learning in medical image analysis. Medical imaging--focusing on particular parts of the …

AnatomyMedical Image AnalysisMedical Image SegmentationSelf-Supervised Learning+1

Visual Representation Learning with Self-Supervised Attention for Low-Label High-data Regime

2022-01-22 · Prarthana Bhattacharyya, Chenge Li, Xiaonan Zhao, István Fehérvári 외

Self-supervision has shown outstanding results for natural language processing, and more recently, for image recognition. Simultaneously, vision transformers and its variants have emerged as a promising and scalable alte…

Few-Shot Image Classificationimage-classificationImage ClassificationImage Retrieval+4