Selecting Relevant Features from a Multi-domain Representation for Few-shot Classification
Popular approaches for few-shot classification consist of first learning a generic data representation based on a large annotated dataset, before adapting the representation to new classes given only a few labeled samples. In this work, we propose a new strategy based on feature selection, which is both simpler and more effective than previous feature adaptation approaches. First, we obtain a multi-domain representation by training a set of semantically different feature extractors. Then, given a few-shot learning task, we use our multi-domain feature bank to automatically select the most relevant representations. We show that a simple non-parametric classifier built on top of such features produces high accuracy and generalizes to domains never seen during training, which leads to state-of-the-art results on MetaDataset and improved accuracy on mini-ImageNet.
Code (1)
Tasks
feature selectionFew-Shot Image ClassificationFew-Shot LearningGeneral ClassificationSimilar Papers 제목 키워드 기반
DomCLP: Domain-wise Contrastive Learning with Prototype Mixup for Unsupervised Domain Generalization
Self-supervised learning (SSL) methods based on the instance discrimination tasks with InfoNCE have achieved remarkable success. Despite their success, SSL models often struggle to generate effective representations for …
Contrastive LearningDomain GeneralizationSelf-Supervised LearningEmploying an Adjusted Stability Measure for Multi-Criteria Model Fitting on Data Sets with Similar Features
Fitting models with high predictive accuracy that include all relevant but no irrelevant or redundant features is a challenging task on data sets with similar (e.g. highly correlated) features. We propose the approach of…
feature selectionLearning to Select Context in a Hierarchical and Global Perspective for Open-domain Dialogue Generation
Open-domain multi-turn conversations mainly have three features, which are hierarchical semantic structure, redundant information, and long-term dependency. Grounded on these, selecting relevant context becomes a challen…
DecoderDialogue GenerationInformativenessExtracting and Selecting Relevant Corpora for Domain Adaptation in MT
Generalizing Few-Shot Named Entity Recognizers to Unseen Domains with Type-Related Features
Few-shot named entity recognition (NER) has shown remarkable progress in identifying entities in low-resource domains. However, few-shot NER methods still struggle with out-of-domain (OOD) examples due to their reliance …
Data Augmentationfew-shot-nerFew-shot NERnamed-entity-recognition+5