paper-with-me

홈 › Papers

The Role of Global Labels in Few-Shot Classification and How to Infer Them

2021-08-09 · NeurIPS 2021 12 · Ruohan Wang, Massimiliano Pontil, Carlo Ciliberto

Few-shot learning is a central problem in meta-learning, where learners must quickly adapt to new tasks given limited training data. Recently, feature pre-training has become a ubiquitous component in state-of-the-art meta-learning methods and is shown to provide significant performance improvement. However, there is limited theoretical understanding of the connection between pre-training and meta-learning. Further, pre-training requires global labels shared across tasks, which may be unavailable in practice. In this paper, we show why exploiting pre-training is theoretically advantageous for meta-learning, and in particular the critical role of global labels. This motivates us to propose Meta Label Learning (MeLa), a novel meta-learning framework that automatically infers global labels to obtains robust few-shot models. Empirically, we demonstrate that MeLa is competitive with existing methods and provide extensive ablation experiments to highlight its key properties.

📄 PDF Abstract BibTeX arXiv:2108.04055

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningMeta-Learning

Similar Papers 제목 키워드 기반

Conformal Predictor for Improving Zero-shot Text Classification Efficiency

2022-10-23 · Prafulla Kumar Choubey, Yu Bai, Chien-Sheng Wu, Wenhao Liu 외

Pre-trained language models (PLMs) have been shown effective for zero-shot (0shot) text classification. 0shot models based on natural language inference (NLI) and next sentence prediction (NSP) employ cross-encoder archi…

ClassificationNatural Language InferenceSentencetext-classification+3

Robust Meta-Representation Learning via Global Label Inference and Classification

2022-12-22 · Ruohan Wang, Isak Falk, Massimiliano Pontil, Carlo Ciliberto

Few-shot learning (FSL) is a central problem in meta-learning, where learners must efficiently learn from few labeled examples. Within FSL, feature pre-training has recently become an increasingly popular strategy to sig…

Few-Shot LearningMeta-LearningRepresentation Learning

The role of class encoding in neural collapse

2026-05-29 · Bastien Massion, Roy Makhlouf, Estelle Massart arxiv

Neural collapse is a structural property of the last-hidden-layer activations in neural network classification models, when trained beyond a zero classification error. In this work, we explore the role of label encoding …

Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corpora

2022-09-14 · COLING 2022 10 · Flor Miriam Plaza-del-Arco, María-Teresa Martín-Valdivia, Roman Klinger

Within textual emotion classification, the set of relevant labels depends on the domain and application scenario and might not be known at the time of model development. This conflicts with the classical paradigm of supe…

Emotion ClassificationNatural Language InferenceZero-Shot Learning

Query Your Model with Definitions in FrameNet: An Effective Method for Frame Semantic Role Labeling

2022-12-05 · Ce Zheng, Yiming Wang, Baobao Chang

Frame Semantic Role Labeling (FSRL) identifies arguments and labels them with frame semantic roles defined in FrameNet. Previous researches tend to divide FSRL into argument identification and role classification. Such m…

ClassificationMulti-class ClassificationSemantic Role Labeling