The Role of Global Labels in Few-Shot Classification and How to Infer Them
Few-shot learning is a central problem in meta-learning, where learners must quickly adapt to new tasks given limited training data. Recently, feature pre-training has become a ubiquitous component in state-of-the-art meta-learning methods and is shown to provide significant performance improvement. However, there is limited theoretical understanding of the connection between pre-training and meta-learning. Further, pre-training requires global labels shared across tasks, which may be unavailable in practice. In this paper, we show why exploiting pre-training is theoretically advantageous for meta-learning, and in particular the critical role of global labels. This motivates us to propose Meta Label Learning (MeLa), a novel meta-learning framework that automatically infers global labels to obtains robust few-shot models. Empirically, we demonstrate that MeLa is competitive with existing methods and provide extensive ablation experiments to highlight its key properties.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningMeta-LearningSimilar Papers 제목 키워드 기반
Conformal Predictor for Improving Zero-shot Text Classification Efficiency
Pre-trained language models (PLMs) have been shown effective for zero-shot (0shot) text classification. 0shot models based on natural language inference (NLI) and next sentence prediction (NSP) employ cross-encoder archi…
ClassificationNatural Language InferenceSentencetext-classification+3Robust Meta-Representation Learning via Global Label Inference and Classification
Few-shot learning (FSL) is a central problem in meta-learning, where learners must efficiently learn from few labeled examples. Within FSL, feature pre-training has recently become an increasingly popular strategy to sig…
Few-Shot LearningMeta-LearningRepresentation LearningThe role of class encoding in neural collapse
Neural collapse is a structural property of the last-hidden-layer activations in neural network classification models, when trained beyond a zero classification error. In this work, we explore the role of label encoding …
Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corpora
Within textual emotion classification, the set of relevant labels depends on the domain and application scenario and might not be known at the time of model development. This conflicts with the classical paradigm of supe…
Emotion ClassificationNatural Language InferenceZero-Shot LearningQuery Your Model with Definitions in FrameNet: An Effective Method for Frame Semantic Role Labeling
Frame Semantic Role Labeling (FSRL) identifies arguments and labels them with frame semantic roles defined in FrameNet. Previous researches tend to divide FSRL into argument identification and role classification. Such m…
ClassificationMulti-class ClassificationSemantic Role Labeling