Transfer learning based few-shot classification using optimal transport mapping from preprocessed latent space of backbone neural network
MetaDL Challenge 2020 focused on image classification tasks in few-shot settings. This paper describes second best submission in the competition. Our meta learning approach modifies the distribution of classes in a latent space produced by a backbone network for each class in order to better follow the Gaussian distribution. After this operation which we call Latent Space Transform algorithm, centers of classes are further aligned in an iterative fashion of the Expectation Maximisation algorithm to utilize information in unlabeled data that are often provided on top of few labelled instances. For this task, we utilize optimal transport mapping using the Sinkhorn algorithm. Our experiments show that this approach outperforms previous works as well as other variants of the algorithm, using K-Nearest Neighbour algorithm, Gaussian Mixture Models, etc.
Code (1)
Tasks
Few-Shot Image ClassificationFew-Shot Learningimage-classificationImage ClassificationMeta-LearningTransfer LearningSimilar Papers 제목 키워드 기반
ZegOT: Zero-shot Segmentation Through Optimal Transport of Text Prompts
Recent success of large-scale Contrastive Language-Image Pre-training (CLIP) has led to great promise in zero-shot semantic segmentation by transferring image-text aligned knowledge to pixel-level classification. However…
SegmentationSemantic SegmentationZero Shot SegmentationZero-Shot Semantic SegmentationImproving Mini-batch Optimal Transport via Partial Transportation
Mini-batch optimal transport (m-OT) has been widely used recently to deal with the memory issue of OT in large-scale applications. Despite their practicality, m-OT suffers from misspecified mappings, namely, mappings tha…
Domain AdaptationPartial Domain AdaptationUniversal Prototype Transport for Zero-Shot Action Recognition and Localization
This work addresses the problem of recognizing action categories in videos when no training examples are available. The current state-of-the-art enables such a zero-shot recognition by learning universal mappings from vi…
Action RecognitionObjectPositionTemporal Localization+3Leveraging the Feature Distribution in Transfer-based Few-Shot Learning
Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed to solve few-shot classification, among which transfer-…
Few-Shot Image ClassificationFew-Shot LearningGeneral ClassificationTransductive Universal Transport for Zero-Shot Action Recognition
This work addresses the problem of recognizing action categories in videos for which no training examples are available. The current state-of-the-art enables such a zero-shot recognition by learning universal mappings fr…
Action RecognitionObjectPositionTemporal Localization+3