One-Way Prototypical Networks
Few-shot models have become a popular topic of research in the past years. They offer the possibility to determine class belongings for unseen examples using just a handful of examples for each class. Such models are trained on a wide range of classes and their respective examples, learning a decision metric in the process. Types of few-shot models include matching networks and prototypical networks. We show a new way of training prototypical few-shot models for just a single class. These models have the ability to predict the likelihood of an unseen query belonging to a group of examples without any given counterexamples. The difficulty here lies in the fact that no relative distance to other classes can be calculated via softmax. We solve this problem by introducing a "null class" centered around zero, and enforcing centering with batch normalization. Trained on the commonly used Omniglot data set, we obtain a classification accuracy of .98 on the matched test set, and of .8 on unmatched MNIST data. On the more complex MiniImageNet data set, test accuracy is .8. In addition, we propose a novel Gaussian layer for distance calculation in a prototypical network, which takes the support examples' distribution rather than just their centroid into account. This extension shows promising results when a higher number of support examples is available.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Prototypical Representation Learning for Low-resource Knowledge Extraction: Summary and Perspective
Recent years have witnessed the success of prototypical representation in widespread low-resource tasks, since "Prototypical Networks for Few-shot Learning (NeurIPS 2017)" proposed to represent each class as a prototype …
Contrastive LearningFew-Shot LearningRelation ExtractionRepresentation LearningPrototypicality Bias Reveals Blindspots in Multimodal Evaluation Metrics
Automatic metrics are widely used to evaluate text-to-image models, often replacing human judgment in benchmarking, model selection, and large-scale data filtering. Yet they may reward images that look plausible or proto…
Gaussian Prototypical Networks for Few-Shot Learning on Omniglot
We propose a novel architecture for $k$-shot classification on the Omniglot dataset. Building on prototypical networks, we extend their architecture to what we call Gaussian prototypical networks. Prototypical networks l…
ClassificationClusteringFew-Shot LearningGeneral ClassificationRethinking Prototypical Contrastive Learning through Alignment, Uniformity and Correlation
Contrastive self-supervised learning (CSL) with a prototypical regularization has been introduced in learning meaningful representations for downstream tasks that require strong semantic information. However, to optimize…
Contrastive LearningDiversitySelf-Supervised LearningPrototypical Fine-tuning: Towards Robust Performance Under Varying Data Sizes
In this paper, we move towards combining large parametric models with non-parametric prototypical networks. We propose prototypical fine-tuning, a novel prototypical framework for fine-tuning pretrained language models (…