Hyperbolic Busemann Learning with Ideal Prototypes
Hyperbolic space has become a popular choice of manifold for representation learning of various datatypes from tree-like structures and text to graphs. Building on the success of deep learning with prototypes in Euclidean and hyperspherical spaces, a few recent works have proposed hyperbolic prototypes for classification. Such approaches enable effective learning in low-dimensional output spaces and can exploit hierarchical relations amongst classes, but require privileged information about class labels to position the hyperbolic prototypes. In this work, we propose Hyperbolic Busemann Learning. The main idea behind our approach is to position prototypes on the ideal boundary of the Poincar\'e ball, which does not require prior label knowledge. To be able to compute proximities to ideal prototypes, we introduce the penalised Busemann loss. We provide theory supporting the use of ideal prototypes and the proposed loss by proving its equivalence to logistic regression in the one-dimensional case. Empirically, we show that our approach provides a natural interpretation of classification confidence, while outperforming recent hyperspherical and hyperbolic prototype approaches.
Code (1)
Tasks
PositionRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Theory of Hyperbolic Prototype Learning
We introduce Hyperbolic Prototype Learning, a type of supervised learning, where class labels are represented by ideal points (points at infinity) in hyperbolic space. Learning is achieved by minimizing the 'penalized Bu…
regressionHyperbolic Busemann Neural Networks
Hyperbolic spaces provide a natural geometry for representing hierarchical and tree-structured data due to their exponential volume growth. To leverage these benefits, neural networks require intrinsic and efficient comp…
Image ClassificationNode ClassificationLink PredictionBusemann energy-based attention for emotion analysis in Poincaré discs
We present EmBolic - a novel fully hyperbolic deep learning architecture for fine-grained emotion analysis from textual messages. The underlying idea is that hyperbolic geometry efficiently captures hierarchies between b…
HMSN: Hyperbolic Self-Supervised Learning by Clustering with Ideal Prototypes
Hyperbolic manifolds for visual representation learning allow for effective learning of semantic class hierarchies by naturally embedding tree-like structures with low distortion within a low-dimensional representation s…
ClusteringFew-Shot LearningLinear evaluationRepresentation Learning+1Hyperbolic Uncertainty-Aware Few-Shot Incremental Point Cloud Segmentation
3D point cloud segmentation is essential across a range of applications; however, conventional methods often struggle in evolving environments, particularly when tasked with identifying novel categories under limited…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningFew-Shot Learning+3