paper-with-me

Papers

Symplectic Bregman divergences

2024-08-23 · Frank Nielsen

We present a generalization of Bregman divergences in symplectic vector spaces that we term symplectic Bregman divergences. Symplectic Bregman divergences are derived from a symplectic generalization of the Fenchel-Young inequality which relies on the notion of symplectic subdifferentials. The symplectic Fenchel-Young inequality is obtained using the symplectic Fenchel transform which is defined with respect to the symplectic form. Since symplectic forms can be generically built from pairings of dual systems, we get a generalization of Bregman divergences in dual systems obtained by equivalent symplectic Bregman divergences. In particular, when the symplectic form is derived from an inner product, we show that the corresponding symplectic Bregman divergences amount to ordinary Bregman divergences with respect to composite inner products. Some potential applications of symplectic divergences in geometric mechanics, information geometry, and learning dynamics in machine learning are touched upon.

📄 PDF Abstract BibTeX arXiv:2408.12961

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Curved representational Bregman divergences and their applications

2025-04-08 · Frank Nielsen

By analogy to curved exponential families in statistics, we define curved Bregman divergences as Bregman divergences restricted to nonlinear parameter subspaces. We show that the barycenter of a finite weighted set of pa…

A note on the quasiconvex Jensen divergences and the quasiconvex Bregman divergences derived thereof

2019-09-19 · Frank Nielsen, Gaëtan Hadjeres

We first introduce the class of strictly quasiconvex and strictly quasiconcave Jensen divergences which are oriented (asymmetric) distances, and study some of their properties. We then define the strictly quasiconvex Bre…

Generalized Bregman and Jensen divergences which include some f-divergences

2018-08-19 · Tomohiro Nishiyama

In this paper, we introduce new classes of divergences by extending the definitions of the Bregman divergence and the skew Jensen divergence. These new divergence classes (g-Bregman divergence and skew g-Jensen divergenc…

Sum decomposition of divergence into three divergences

2018-10-03 · Tomohiro Nishiyama

Divergence functions play a key role as to measure the discrepancy between two points in the field of machine learning, statistics and signal processing. Well-known divergences are the Bregman divergences, the Jensen div…

BIG-bench Machine Learning

Generalising maximum mean discrepancy: kernelised functional Bregman divergences

2026-04-27 · Russell Tsuchida, Frank Nielsen arxiv

Bregman divergences play a pivotal role in statistics, machine learning and computational information geometry. Particularly in the context of machine learning, they are central to clustering, exponential families, param…