Episodic-free Task Selection for Few-shot Learning
Episodic training is a mainstream training strategy for few-shot learning. In few-shot scenarios, however, this strategy is often inferior to some non-episodic training strategy, e. g., Neighbourhood Component Analysis (NCA), which challenges the principle that training conditions must match testing conditions. Thus, a question is naturally asked: How to search for episodic-free tasks for better few-shot learning? In this work, we propose a novel meta-training framework beyond episodic training. In this framework, episodic tasks are not used directly for training, but for evaluating the effectiveness of some selected episodic-free tasks from a task set that are performed for training the meta-learners. The selection criterion is designed with the affinity, which measures the degree to which loss decreases when executing the target tasks after training with the selected tasks. In experiments, the training task set contains some promising types, e. g., contrastive learning and classification, and the target few-shot tasks are achieved with the nearest centroid classifiers on the miniImageNet, tiered-ImageNet and CIFAR-FS datasets. The experimental results demonstrate the effectiveness of our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningFew-Shot LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Meta-free few-shot learning via representation learning with weight averaging
Recent studies on few-shot classification using transfer learning pose challenges to the effectiveness and efficiency of episodic meta-learning algorithms. Transfer learning approaches are a natural alternative, but they…
ClassificationFew-Shot LearningMeta-LearningRepresentation Learning+1Semi Supervised Learning For Few-shot Audio Classification By Episodic Triplet Mining
Few-shot learning aims to generalize unseen classes that appear during testing but are unavailable during training. Prototypical networks incorporate few-shot metric learning, by constructing a class prototype in the for…
Audio ClassificationEvent DetectionFew-Shot Audio ClassificationFew-Shot Learning+5Deep Episodic Value Iteration for Model-based Meta-Reinforcement Learning
We present a new deep meta reinforcement learner, which we call Deep Episodic Value Iteration (DEVI). DEVI uses a deep neural network to learn a similarity metric for a non-parametric model-based reinforcement learning a…
Meta Reinforcement LearningModel-based Reinforcement LearningQ-Learningreinforcement-learning+2On the Role of Pre-training for Meta Few-Shot Learning
Few-shot learning aims to classify unknown classes of examples with a few new examples per class. There are two key routes for few-shot learning. One is to (pre-)train a classifier with examples from known classes, and t…
DisentanglementFew-Shot LearningLearning Flexible Classifiers with Shot-CONditional Episodic (SCONE) Training
Early few-shot classification work advocates for episodic training, i.e. training over learning episodes each posing a few-shot classification task. However, the role of this training regime remains poorly understood, an…
ClassificationGeneral Classification