paper-with-me

홈 › Papers

Episodic-free Task Selection for Few-shot Learning

2024-01-31 · Tao Zhang

Episodic training is a mainstream training strategy for few-shot learning. In few-shot scenarios, however, this strategy is often inferior to some non-episodic training strategy, e. g., Neighbourhood Component Analysis (NCA), which challenges the principle that training conditions must match testing conditions. Thus, a question is naturally asked: How to search for episodic-free tasks for better few-shot learning? In this work, we propose a novel meta-training framework beyond episodic training. In this framework, episodic tasks are not used directly for training, but for evaluating the effectiveness of some selected episodic-free tasks from a task set that are performed for training the meta-learners. The selection criterion is designed with the affinity, which measures the degree to which loss decreases when executing the target tasks after training with the selected tasks. In experiments, the training task set contains some promising types, e. g., contrastive learning and classification, and the target few-shot tasks are achieved with the nearest centroid classifiers on the miniImageNet, tiered-ImageNet and CIFAR-FS datasets. The experimental results demonstrate the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2402.00092

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningFew-Shot Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Meta-free few-shot learning via representation learning with weight averaging

2022-04-26 · Kuilin Chen, Chi-Guhn Lee

Recent studies on few-shot classification using transfer learning pose challenges to the effectiveness and efficiency of episodic meta-learning algorithms. Transfer learning approaches are a natural alternative, but they…

ClassificationFew-Shot LearningMeta-LearningRepresentation Learning+1

Semi Supervised Learning For Few-shot Audio Classification By Episodic Triplet Mining

2021-02-16 · Swapnil Bhosale, Rupayan Chakraborty, Sunil Kumar Kopparapu

Few-shot learning aims to generalize unseen classes that appear during testing but are unavailable during training. Prototypical networks incorporate few-shot metric learning, by constructing a class prototype in the for…

Audio ClassificationEvent DetectionFew-Shot Audio ClassificationFew-Shot Learning+5

Deep Episodic Value Iteration for Model-based Meta-Reinforcement Learning

2017-05-09 · Steven Stenberg Hansen

We present a new deep meta reinforcement learner, which we call Deep Episodic Value Iteration (DEVI). DEVI uses a deep neural network to learn a similarity metric for a non-parametric model-based reinforcement learning a…

Meta Reinforcement LearningModel-based Reinforcement LearningQ-Learningreinforcement-learning+2

On the Role of Pre-training for Meta Few-Shot Learning

2021-01-01 · Chia-You Chen, Hsuan-Tien Lin, Gang Niu, Masashi Sugiyama

Few-shot learning aims to classify unknown classes of examples with a few new examples per class. There are two key routes for few-shot learning. One is to (pre-)train a classifier with examples from known classes, and t…

DisentanglementFew-Shot Learning

Learning Flexible Classifiers with Shot-CONditional Episodic (SCONE) Training

2021-01-01 · Eleni Triantafillou, Vincent Dumoulin, Hugo Larochelle, Richard Zemel

Early few-shot classification work advocates for episodic training, i.e. training over learning episodes each posing a few-shot classification task. However, the role of this training regime remains poorly understood, an…

ClassificationGeneral Classification