Transductive Decoupled Variational Inference for Few-Shot Classification
The versatility to learn from a handful of samples is the hallmark of human intelligence. Few-shot learning is an endeavour to transcend this capability down to machines. Inspired by the promise and power of probabilistic deep learning, we propose a novel variational inference network for few-shot classification (coined as TRIDENT) to decouple the representation of an image into semantic and label latent variables, and simultaneously infer them in an intertwined fashion. To induce task-awareness, as part of the inference mechanics of TRIDENT, we exploit information across both query and support images of a few-shot task using a novel built-in attention-based transductive feature extraction module (we call AttFEX). Our extensive experimental results corroborate the efficacy of TRIDENT and demonstrate that, using the simplest of backbones, it sets a new state-of-the-art in the most commonly adopted datasets miniImageNet and tieredImageNet (offering up to 4% and 5% improvements, respectively), as well as for the recent challenging cross-domain miniImagenet --> CUB scenario offering a significant margin (up to 20% improvement) beyond the best existing cross-domain baselines. Code and experimentation can be found in our GitHub repository: https://github.com/anujinho/trident
Code (1)
Tasks
ClassificationFew-Shot Image ClassificationFew-Shot LearningProbabilistic Deep LearningVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
Few-shot Open-set audio classification requires classifying query samples from known classes with a few labeled support samples while rejecting query samples from unknown classes. Transductive inference jointly observes …
Audio ClassificationAdaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classification
Transductive Few-Shot learning has gained increased attention nowadays considering the cost of data annotations along with the increased accuracy provided by unlabelled samples in the domain of few shot. Especially in Fe…
Bayesian InferenceClusteringDimensionality ReductionFew-Shot Image Classification+2Empirical Bayes Transductive Meta-Learning with Synthetic Gradients
We propose a meta-learning approach that learns from multiple tasks in a transductive setting, by leveraging the unlabeled query set in addition to the support set to generate a more powerful model for each task. To deve…
Few-Shot Image ClassificationMeta-LearningMulti-Task LearningVariational Inference+1Transductive Zero-Shot and Few-Shot CLIP
Transductive inference has been widely investigated in few-shot image classification but completely overlooked in the recent fast growing literature on adapting vision-langage models like CLIP. This paper addresses t…
ClassificationFew-Shot Image Classificationimage-classificationImage ClassificationTransductive Learning for Textual Few-Shot Classification in API-based Embedding Models
Proprietary and closed APIs are becoming increasingly common to process natural language, and are impacting the practical applications of natural language processing, including few-shot classification. Few-shot classific…
ClassificationInductive LearningTransductive Learning