Variational Neuron Shifting for Few-Shot Image Classification Across Domains
Few-shot image classification aims to recognize unseen classes with few labeled samples. Existing meta-learning models learn the ability of learning good representation or model parameters, in order to adapt to new tasks with a few training samples. However, when there exists a domain gap between training and test tasks, the learned ability often does not generalize well across domains, resulting in degraded performance on new tasks. In this article, we propose variational neuron shifting to generate adapted feature representations for few-shot learning. To do so, we introduce a working memory module to store the shifted neurons from the support set, which will be accessed to generate adapted feature representations of query samples. Under the metalearning paradigm, the model is learned to acquire the ability of adaptation with single sample at meta-training time so as to further adapt itself to each single test sample at meta-test time. We formulate the adaptation process as a variational Bayesian inference problem, which incorporates the test sample as the condition into the generation of the model neuron shifting. We conduct extensive experiments on both within and across domain few-shot classification tasks. The new state-of-the-art performance substantiates the effectiveness of our variational neuron shifting. The thorough ablation studies further demonstrate the benefit of each component in our model.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceFew-Shot Image ClassificationFew-Shot Learningimage-classificationImage ClassificationMeta-LearningSimilar Papers 제목 키워드 기반
Task-Prior Conditional Variational Auto-Encoder for Few-Shot Image Classification
Transductive methods always outperform inductive methods in few-shot image classification scenarios. However, the existing few-shot methods contain a latent condition: the number of samples in each class is the same, whi…
Few-Shot Image ClassificationFew-Shot Learningimage-classificationImage ClassificationVariational Capsules for Image Analysis and Synthesis
A capsule is a group of neurons whose activity vector models different properties of the same entity. This paper extends the capsule to a generative version, named variational capsules (VCs). Each VC produces a latent va…
AttributeDiversityGeneral Classificationimage-classification+2Neuron Abandoning Attention Flow: Visual Explanation of Dynamics inside CNN Models
In this paper, we present a Neuron Abandoning Attention Flow (NAFlow) method to address the open problem of visually explaining the attention evolution dynamics inside CNNs when making their classification decisions. A n…
ClassificationContrastive LearningDecision MakingFew-Shot Image Classification+3Dense Classification and Implanting for Few-Shot Learning
Training deep neural networks from few examples is a highly challenging and key problem for many computer vision tasks. In this context, we are targeting knowledge transfer from a set with abundant data to other sets wit…
ClassificationFew-Shot LearningGeneral ClassificationTransfer LearningCortical Surface Co-Registration based on MRI Images and Photos
Brain shift, i.e. the change in configuration of the brain after opening the dura mater, is a key problem in neuronavigation. We present an approach to co-register intra-operative microscope images with pre-operative MRI…
General ClassificationRobust classification