Few-shot Classification with Hypersphere Modeling of Prototypes

2022-11-10 · Ning Ding, Yulin Chen, Ganqu Cui, Xiaobin Wang, Hai-Tao Zheng, Zhiyuan Liu, Pengjun Xie

Metric-based meta-learning is one of the de facto standards in few-shot learning. It composes of representation learning and metrics calculation designs. Previous works construct class representations in different ways, varying from mean output embedding to covariance and distributions. However, using embeddings in space lacks expressivity and cannot capture class information robustly, while statistical complex modeling poses difficulty to metric designs. In this work, we use tensor fields (``areas'') to model classes from the geometrical perspective for few-shot learning. We present a simple and effective method, dubbed hypersphere prototypes (HyperProto), where class information is represented by hyperspheres with dynamic sizes with two sets of learnable parameters: the hypersphere's center and the radius. Extending from points to areas, hyperspheres are much more expressive than embeddings. Moreover, it is more convenient to perform metric-based classification with hypersphere prototypes than statistical modeling, as we only need to calculate the distance from a data point to the surface of the hypersphere. Following this idea, we also develop two variants of prototypes under other measurements. Extensive experiments and analysis on few-shot learning tasks across NLP and CV and comparison with 20+ competitive baselines demonstrate the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2211.05319

Code (0)

등록된 구현이 없습니다.

Tasks

Classification Few-Shot Learning Meta-Learning Representation Learning

Few-shot Learning with Big Prototypes

2021-09-29 · Ning Ding, Yulin Chen, Xiaobin Wang, Hai-Tao Zheng 외

Using dense vectors, i.e., prototypes, to represent abstract information of classes has become a common approach in low-data machine learning scenarios. Typically, prototypes are mean output embeddings over the instances…

Few-Shot Learning

Fine-Grain Few-Shot Vision via Domain Knowledge as Hyperspherical Priors

2020-05-23 · Bijan Haney, Alexander Lavin

Prototypical networks have been shown to perform well at few-shot learning tasks in computer vision. Yet these networks struggle when classes are very similar to each other (fine-grain classification) and currently have …

Classification Few-Shot Learning General Classification

Hyperspherical Prototype Networks

2019-01-29 · NeurIPS 2019 12 · Pascal Mettes, Elise van der Pol, Cees G. M. Snoek

This paper introduces hyperspherical prototype networks, which unify classification and regression with prototypes on hyperspherical output spaces. For classification, a common approach is to define prototypes as the mea…

Classification General Classification regression

Polar Prototype Networks

2019-05-01 · ICLR 2019 5 · Pascal Mettes, Elise van der Pol, Cees G. M. Snoek

This paper proposes a neural network for classification and regression, without the need to learn layout structures in the output space. Standard solutions such as softmax cross-entropy and mean squared error are effecti…

Classification General Classification regression

Cross-Modal Prototype Alignment and Mixing for Training-Free Few-Shot Classification

2026-03-25 · Dipam Goswami, Simone Magistri, Gido M. van de Ven, Bartłomiej Twardowski 외 arxiv

Vision-language models (VLMs) like CLIP are trained with the objective of aligning text and image pairs. To improve CLIP-based few-shot image classification, recent works have observed that, along with text embeddings, i…

Few-Shot Image Classification