Improving Hyperbolic Representations via Gromov-Wasserstein Regularization
Hyperbolic representations have shown remarkable efficacy in modeling inherent hierarchies and complexities within data structures. Hyperbolic neural networks have been commonly applied for learning such representations from data, but they often fall short in preserving the geometric structures of the original feature spaces. In response to this challenge, our work applies the Gromov-Wasserstein (GW) distance as a novel regularization mechanism within hyperbolic neural networks. The GW distance quantifies how well the original data structure is maintained after embedding the data in a hyperbolic space. Specifically, we explicitly treat the layers of the hyperbolic neural networks as a transport map and calculate the GW distance accordingly. We validate that the GW distance computed based on a training set well approximates the GW distance of the underlying data distribution. Our approach demonstrates consistent enhancements over current state-of-the-art methods across various tasks, including few-shot image classification, as well as semi-supervised graph link prediction and node classification.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Image Classificationimage-classificationImage ClassificationLink PredictionNode ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Node-Specific Space Selection via Localized Geometric Hyperbolicity in Graph Neural Networks
Many graph neural networks have been developed to learn graph representations in either Euclidean or hyperbolic space, with all nodes' representations embedded in a single space. However, a graph can have hyperbolic and …
Graph Neural NetworkLink PredictionNode ClassificationEntropic Gromov-Wasserstein between Gaussian Distributions
We study the entropic Gromov-Wasserstein and its unbalanced version between (unbalanced) Gaussian distributions with different dimensions. When the metric is the inner product, which we refer to as inner product Gromov-W…
FormImproving Relational Regularized Autoencoders with Spherical Sliced Fused Gromov Wasserstein
Relational regularized autoencoder (RAE) is a framework to learn the distribution of data by minimizing a reconstruction loss together with a relational regularization on the latent space. A recent attempt to reduce the …
Image GenerationLearning Structure-enhanced Temporal Point Processes with Gromov-Wasserstein Regularization
Real-world event sequences are often generated by different temporal point processes (TPPs) and thus have clustering structures. Nonetheless, in the modeling and prediction of event sequences, most existing TPPs ignore t…
ClusteringPoint ProcessesThe Joint Gromov Wasserstein Objective for Multiple Object Matching
The Gromov-Wasserstein (GW) distance serves as a powerful tool for matching objects in metric spaces. However, its traditional formulation is constrained to pairwise matching between single objects, limiting its utility …
Computational Efficiency