Matching Networks for One Shot Learning
Learning from a few examples remains a key challenge in machine learning. Despite recent advances in important domains such as vision and language, the standard supervised deep learning paradigm does not offer a satisfactory solution for learning new concepts rapidly from little data. In this work, we employ ideas from metric learning based on deep neural features and from recent advances that augment neural networks with external memories. Our framework learns a network that maps a small labelled support set and an unlabelled example to its label, obviating the need for fine-tuning to adapt to new class types. We then define one-shot learning problems on vision (using Omniglot, ImageNet) and language tasks. Our algorithm improves one-shot accuracy on ImageNet from 87.6% to 93.2% and from 88.0% to 93.8% on Omniglot compared to competing approaches. We also demonstrate the usefulness of the same model on language modeling by introducing a one-shot task on the Penn Treebank.
Code (26)
Tasks
Few-Shot Image ClassificationFew-Shot LearningLanguage ModelingLanguage ModellingMetric LearningOne-Shot LearningSimilar Papers 제목 키워드 기반
RE-Matching: A Fine-Grained Semantic Matching Method for Zero-Shot Relation Extraction
Semantic matching is a mainstream paradigm of zero-shot relation extraction, which matches a given input with a corresponding label description. The entities in the input should exactly match their hypernyms in the descr…
RelationRelation ExtractionSentenceRethinking matching-based few-shot action recognition
Few-shot action recognition, i.e. recognizing new action classes given only a few examples, benefits from incorporating temporal information. Prior work either encodes such information in the representation itself and le…
Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionEnd-to-End Context-Aided Unicity Matching for Person Re-identification
Most existing person re-identification methods compute the matching relations between person images across camera views based on the ranking of the pairwise similarities. This matching strategy with the lack of the globa…
Graph MatchingPerson Re-IdentificationZero-Shot Cross-Domain Code Search without Fine-Tuning
Code search aims to retrieve semantically relevant code snippets for natural language queries. While pre-trained language models (PLMs) have shown remarkable performance in this task, they struggle in cross-domain scenar…
Code SearchNatural Language QueriesLearning to Focus: Cascaded Feature Matching Network for Few-shot Image Recognition
Deep networks can learn to accurately recognize objects of a category by training on a large number of annotated images. However, a meta-learning challenge known as a low-shot image recognition task comes when only a few…
Few-Shot LearningMeta-Learning