von Mises-Fisher distributions and their statistical divergence
The von Mises-Fisher family is a parametric family of distributions on the surface of the unit ball, summarised by a concentration parameter and a mean direction. As a quasi-Bayesian prior, the von Mises-Fisher distribution is a convenient and parsimonious choice when parameter spaces are isomorphic to the hypersphere (e.g., maximum score estimation in semi-parametric discrete choice, estimation of single-index treatment assignment rules via empirical welfare maximisation, under-identifying linear simultaneous equation models). Despite a long history of application, measures of statistical divergence have not been analytically characterised for von Mises-Fisher distributions. This paper provides analytical expressions for the $f$-divergence of a von Mises-Fisher distribution from another, distinct, von Mises-Fisher distribution in $\mathbb{R}^p$ and the uniform distribution over the hypersphere. This paper also collect several other results pertaining to the von Mises-Fisher family of distributions, and characterises the limiting behaviour of the measures of divergence that we consider.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Note on the Kullback-Leibler Divergence for the von Mises-Fisher distribution
We present a derivation of the Kullback Leibler (KL)-Divergence (also known as Relative Entropy) for the von Mises Fisher (VMF) Distribution in $d$-dimensions.
Von Mises-Fisher Mixture Model with Dynamic Shrinkage for Realistic Test-Time Transduction
A range of methods aim to enhance the performance of vision-language models (VLMs) at test time. Among them, transduction has emerged as a promising paradigm due to its strong compatibility and efficiency. However, reali…
On Voronoi diagrams and dual Delaunay complexes on the information-geometric Cauchy manifolds
We study the Voronoi diagrams of a finite set of Cauchy distributions and their dual complexes from the viewpoint of information geometry by considering the Fisher-Rao distance, the Kullback-Leibler divergence, the chi s…
The Power Spherical distribution
There is a growing interest in probabilistic models defined in hyper-spherical spaces, be it to accommodate observed data or latent structure. The von Mises-Fisher (vMF) distribution, often regarded as the Normal distrib…
A Non-Asymptotic Analysis for Stein Variational Gradient Descent
We study the Stein Variational Gradient Descent (SVGD) algorithm, which optimises a set of particles to approximate a target probability distribution $\pi\propto e^{-V}$ on $\mathbb{R}^d$. In the population limit, SVGD p…
LEMMA