Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks
Meta-learning has become a practical approach towards few-shot image classification, where "a strategy to learn a classifier" is meta-learned on labeled base classes and can be applied to tasks with novel classes. We remove the requirement of base class labels and learn generalizable embeddings via Unsupervised Meta-Learning (UML). Specifically, episodes of tasks are constructed with data augmentations from unlabeled base classes during meta-training, and we apply embedding-based classifiers to novel tasks with labeled few-shot examples during meta-test. We observe two elements play important roles in UML, i.e., the way to sample tasks and measure similarities between instances. Thus we obtain a strong baseline with two simple modifications -- a sufficient sampling strategy constructing multiple tasks per episode efficiently together with a semi-normalized similarity. We then take advantage of the characteristics of tasks from two directions to get further improvements. First, synthesized confusing instances are incorporated to help extract more discriminative embeddings. Second, we utilize an additional task-specific embedding transformation as an auxiliary component during meta-training to promote the generalization ability of the pre-adapted embeddings. Experiments on few-shot learning benchmarks verify that our approaches outperform previous UML methods and achieve comparable or even better performance than its supervised variants.
Code (1)
Tasks
Few-Shot Image ClassificationFew-Shot Learningimage-classificationImage ClassificationMeta-LearningUnsupervised Few-Shot Image ClassificationUnsupervised Few-Shot LearningSimilar Papers 제목 키워드 기반
Is Meta-Learning Out? Rethinking Unsupervised Few-Shot Classification with Limited Entropy
Meta-learning is a powerful paradigm for tackling few-shot tasks. However, recent studies indicate that models trained with the whole-class training strategy can achieve comparable performance to those trained with meta-…
Few-Shot Image Classification via Contrastive Self-Supervised Learning
Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. I…
ClassificationFew-Shot Image ClassificationFew-Shot LearningGeneral Classification+5Unsupervised Meta-Learning via Few-shot Pseudo-supervised Contrastive Learning
Unsupervised meta-learning aims to learn generalizable knowledge across a distribution of tasks constructed from unlabeled data. Here, the main challenge is how to construct diverse tasks for meta-learning without label …
Contrastive LearningCross-Domain Few-ShotMeta-LearningSelf-Supervised LearningUnsupervised Meta-Learning via Dynamic Head and Heterogeneous Task Construction for Few-Shot Classification
Meta-learning has been widely used in recent years in areas such as few-shot learning and reinforcement learning. However, the questions of why and when it is better than other algorithms in few-shot classification remai…
Few-Shot LearningMeta-LearningUnsupervised Meta-Learning For Few-Shot Image Classification
Few-shot or one-shot learning of classifiers requires a significant inductive bias towards the type of task to be learned. One way to acquire this is by meta-learning on tasks similar to the target task. In this paper, w…
ClassificationFew-Shot Image ClassificationFew-Shot LearningGeneral Classification+8