paper-with-me

홈 › Papers

Learning over von Mises-Fisher Distributions via a Wasserstein-like Geometry

2025-04-19 · Kisung You, Dennis Shung, Mauro Giuffrè

We introduce a novel, geometry-aware distance metric for the family of von Mises-Fisher (vMF) distributions, which are fundamental models for directional data on the unit hypersphere. Although the vMF distribution is widely employed in a variety of probabilistic learning tasks involving spherical data, principled tools for comparing vMF distributions remain limited, primarily due to the intractability of normalization constants and the absence of suitable geometric metrics. Motivated by the theory of optimal transport, we propose a Wasserstein-like distance that decomposes the discrepancy between two vMF distributions into two interpretable components: a geodesic term capturing the angular separation between mean directions, and a variance-like term quantifying differences in concentration parameters. The derivation leverages a Gaussian approximation in the high-concentration regime to yield a tractable, closed-form expression that respects the intrinsic spherical geometry. We show that the proposed distance exhibits desirable theoretical properties and induces a latent geometric structure on the space of non-degenerate vMF distributions. As a primary application, we develop the efficient algorithms for vMF mixture reduction, enabling structure-preserving compression of mixture models in high-dimensional settings. Empirical results on synthetic datasets and real-world high-dimensional embeddings, including biomedical sentence representations and deep visual features, demonstrate the effectiveness of the proposed geometry in distinguishing distributions and supporting interpretable inference. This work expands the statistical toolbox for directional data analysis by introducing a tractable, transport-inspired distance tailored to the geometry of the hypersphere.

📄 PDF Abstract BibTeX arXiv:2504.14164

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Improving Relational Regularized Autoencoders with Spherical Sliced Fused Gromov Wasserstein

2020-10-05 · ICLR 2021 1 · Khai Nguyen, Son Nguyen, Nhat Ho, Tung Pham 외

Relational regularized autoencoder (RAE) is a framework to learn the distribution of data by minimizing a reconstruction loss together with a relational regularization on the latent space. A recent attempt to reduce the …

Image Generation

von Mises-Fisher distributions and their statistical divergence

2022-02-10 · Toru Kitagawa, Jeff Rowley

The von Mises-Fisher family is a parametric family of distributions on the surface of the unit ball, summarised by a concentration parameter and a mean direction. As a quasi-Bayesian prior, the von Mises-Fisher distribut…

Mixture of von Mises-Fisher distribution with sparse prototypes

2022-12-30 · Fabrice Rossi, Florian Barbaro

Mixtures of von Mises-Fisher distributions can be used to cluster data on the unit hypersphere. This is particularly adapted for high-dimensional directional data such as texts. We propose in this article to estimate a v…

Clustering

Attitude Estimation via Matrix Fisher Distributions on SO(3) Using Non-Unit Vector Measurements

2024-10-15 · Shijie Wang, Haichao Gui, Rui Zhong

This note presents a novel Bayesian attitude estimator with the matrix Fisher distribution on the special orthogonal group, which can smoothly accommodate both unit and non-unit vector measurements. The posterior attitud…

A solution for the mean parametrization of the von Mises-Fisher distribution

2024-04-10 · Marcel Nonnenmacher, Maneesh Sahani

The von Mises-Fisher distribution as an exponential family can be expressed in terms of either its natural or its mean parameters. Unfortunately, however, the normalization function for the distribution in terms of its m…

Form