paper-with-me

홈 › Papers

Generalized Bayesian Cramér-Rao Inequality via Information Geometry of Relative $α$-Entropy

2020-02-11 · Kumar Vijay Mishra, M. Ashok Kumar

The relative $\alpha$-entropy is the R\'enyi analog of relative entropy and arises prominently in information-theoretic problems. Recent information geometric investigations on this quantity have enabled the generalization of the Cram\'{e}r-Rao inequality, which provides a lower bound for the variance of an estimator of an escort of the underlying parametric probability distribution. However, this framework remains unexamined in the Bayesian framework. In this paper, we propose a general Riemannian metric based on relative $\alpha$-entropy to obtain a generalized Bayesian Cram\'{e}r-Rao inequality. This establishes a lower bound for the variance of an unbiased estimator for the $\alpha$-escort distribution starting from an unbiased estimator for the underlying distribution. We show that in the limiting case when the entropy order approaches unity, this framework reduces to the conventional Bayesian Cram\'{e}r-Rao inequality. Further, in the absence of priors, the same framework yields the deterministic Cram\'{e}r-Rao inequality.

📄 PDF Abstract BibTeX arXiv:2002.04732

Code (0)

등록된 구현이 없습니다.

Tasks

Unity

Similar Papers 제목 키워드 기반

Information Geometry and Classical Cramér-Rao Type Inequalities

2021-04-02 · Kumar Vijay Mishra, M. Ashok Kumar

We examine the role of information geometry in the context of classical Cram\'er-Rao (CR) type inequalities. In particular, we focus on Eguchi's theory of obtaining dualistic geometric structures from a divergence functi…

Vocal Bursts Type Prediction

On some interrelations of generalized $q$-entropies and a generalized Fisher information, including a Cramér-Rao inequality

2013-05-27 · Jean-François Bercher

In this communication, we describe some interrelations between generalized $q$-entropies and a generalized version of Fisher information. In information theory, the de Bruijn identity links the Fisher information and the…

Cramér-Rao Lower Bounds Arising from Generalized Csiszár Divergences

2020-01-14 · M. Ashok Kumar, Kumar Vijay Mishra

We study the geometry of probability distributions with respect to a generalized family of Csisz\'ar $f$-divergences. A member of this family is the relative $\alpha$-entropy which is also a R\'enyi analog of relative en…

Intrinsic Bayesian Cramér-Rao Bound with an Application to Covariance Matrix Estimation

2023-11-08 · Florent Bouchard, Alexandre Renaux, Guillaume Ginolhac, Arnaud Breloy

This paper presents a new performance bound for estimation problems where the parameter to estimate lies in a Riemannian manifold (a smooth manifold endowed with a Riemannian metric) and follows a given prior distributio…

On the Achievability of Cramér-Rao Bound In Noisy Compressed Sensing

2010-06-13 · Rad Niazadeh, Masoud Babaie-Zadeh, Christian Jutten

Recently, it has been proved in Babadi et al. that in noisy compressed sensing, a joint typical estimator can asymptotically achieve the Cramer-Rao lower bound of the problem.To prove this result, this paper used a lemma…

compressed sensingLEMMA