paper-with-me

홈 › Papers

Relationship between Hölder Divergence and Functional Density Power Divergence: Intersection and Generalization

2025-04-23 · Masahiro Kobayashi

In this study, we discuss the relationship between two families of density-power-based divergences with functional degrees of freedom -- the H\"{o}lder divergence and the functional density power divergence (FDPD) -- based on their intersection and generalization. These divergence families include the density power divergence and the $\gamma$-divergence as special cases. First, we prove that the intersection of the H\"{o}lder divergence and the FDPD is limited to a general divergence family introduced by Jones et al. (Biometrika, 2001). Subsequently, motivated by the fact that H\"{o}lder's inequality is used in the proofs of nonnegativity for both the H\"{o}lder divergence and the FDPD, we define a generalized divergence family, referred to as the $\xi$-H\"{o}lder divergence. The nonnegativity of the $\xi$-H\"{o}lder divergence is established through a combination of the inequalities used to prove the nonnegativity of the H\"{o}lder divergence and the FDPD. Furthermore, we derive an inequality between the composite scoring rules corresponding to different FDPDs based on the $\xi$-H\"{o}lder divergence. Finally, we prove that imposing the mathematical structure of the H\"{o}lder score on a composite scoring rule results in the $\xi$-H\"{o}lder divergence.

📄 PDF Abstract BibTeX arXiv:2504.17008

Code (0)

등록된 구현이 없습니다.

Tasks

scoring rule

Similar Papers 제목 키워드 기반

Exponential Concentration of a Density Functional Estimator

2016-03-28 · NeurIPS 2014 12 · Shashank Singh, Barnabás P óczos

We analyze a plug-in estimator for a large class of integral functionals of one or more continuous probability densities. This class includes important families of entropy, divergence, mutual information, and their condi…

A Unified Representation of Density-Power-Based Divergences Reducible to M-Estimation

2025-01-27 · Masahiro Kobayashi

Density-power-based divergences are known to provide robust inference procedures against outliers, and their extensions have been widely studied. A characteristic of successful divergences is that the estimation problem …

Partition Function Estimation under Bounded f-Divergence

2026-02-26 · Adam Block, Abhishek Shetty arxiv

We study the statistical complexity of estimating partition functions given sample access to a proposal distribution and an unnormalized density ratio for a target distribution. While partition function estimation is a c…

Direct estimation of density functionals using a polynomial basis

2017-02-21 · Alan Wisler, Visar Berisha, Andreas Spanias, Alfred O. Hero

A number of fundamental quantities in statistical signal processing and information theory can be expressed as integral functions of two probability density functions. Such quantities are called density functionals as th…

Density Estimation

Bounds on $L_p$ Errors in Density Ratio Estimation via $f$-Divergence Loss Functions

2024-10-02 · Yoshiaki Kitazawa

Density ratio estimation (DRE) is a fundamental machine learning technique for identifying relationships between two probability distributions. $f$-divergence loss functions, derived from variational representations of $…

Density Ratio Estimation