Toward Better Generalization in Few-Shot Learning through the Meta-Component Combination
In few-shot learning, classifiers are expected to generalize to unseen classes given only a small number of instances of each new class. One of the popular solutions to few-shot learning is metric-based meta-learning. However, it highly depends on the deep metric learned on seen classes, which may overfit to seen classes and fail to generalize well on unseen classes. To improve the generalization, we explore the substructures of classifiers and propose a novel meta-learning algorithm to learn each classifier as a combination of meta-components. Meta-components are learned across meta-learning episodes on seen classes and disentangled by imposing an orthogonal regularizer to promote its diversity and capture various shared substructures among different classifiers. Extensive experiments on few-shot benchmark tasks show superior performances of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningSimilar Papers 제목 키워드 기반
MetaDelta: A Meta-Learning System for Few-shot Image Classification
Meta-learning aims at learning quickly on novel tasks with limited data by transferring generic experience learned from previous tasks. Naturally, few-shot learning has been one of the most popular applications for meta-…
ClassificationDecoderFew-Shot Image ClassificationFew-Shot Learning+4Dynamic Memory Induction Networks for Few-Shot Text Classification
This paper proposes Dynamic Memory Induction Networks (DMIN) for few-shot text classification. The model utilizes dynamic routing to provide more flexibility to memory-based few-shot learning in order to better adapt the…
ClassificationFew-Shot LearningFew-Shot Text ClassificationGeneral Classification+3FAITH: Few-Shot Graph Classification with Hierarchical Task Graphs
Few-shot graph classification aims at predicting classes for graphs, given limited labeled graphs for each class. To tackle the bottleneck of label scarcity, recent works propose to incorporate few-shot learning framewor…
ClassificationFew-Shot LearningGraph ClassificationRevisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks
Meta-learning has become a practical approach towards few-shot image classification, where "a strategy to learn a classifier" is meta-learned on labeled base classes and can be applied to tasks with novel classes. We rem…
Few-Shot Image ClassificationFew-Shot Learningimage-classificationImage Classification+3Meta-Learning with Differentiable Convex Optimization
Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better gen…
Few-Shot Image ClassificationFew-Shot LearningMeta-Learning