paper-with-me

홈 › Papers

Learned Bayesian Cramér-Rao Bound for Unknown Measurement Models Using Score Neural Networks

2025-02-02 · Hai Victor Habi, Hagit Messer, Yoram Bresler

The Bayesian Cram\'er-Rao bound (BCRB) is a crucial tool in signal processing for assessing the fundamental limitations of any estimation problem as well as benchmarking within a Bayesian frameworks. However, the BCRB cannot be computed without full knowledge of the prior and the measurement distributions. In this work, we propose a fully learned Bayesian Cram\'er-Rao bound (LBCRB) that learns both the prior and the measurement distributions. Specifically, we suggest two approaches to obtain the LBCRB: the Posterior Approach and the Measurement-Prior Approach. The Posterior Approach provides a simple method to obtain the LBCRB, whereas the Measurement-Prior Approach enables us to incorporate domain knowledge to improve the sample complexity and {interpretability}. To achieve this, we introduce a Physics-encoded score neural network which enables us to easily incorporate such domain knowledge into a neural network. We {study the learning} errors of the two suggested approaches theoretically, and validate them numerically. We demonstrate the two approaches on several signal processing examples, including a linear measurement problem with unknown mixing and Gaussian noise covariance matrices, frequency estimation, and quantized measurement. In addition, we test our approach on a nonlinear signal processing problem of frequency estimation with real-world underwater ambient noise.

📄 PDF Abstract BibTeX arXiv:2502.00724

Code (1)

haihabi/learned-bcrb 공식 구현 pytorch

Tasks

Benchmarking

Similar Papers 제목 키워드 기반

Intrinsic Bayesian Cramér-Rao Bound with an Application to Covariance Matrix Estimation

2023-11-08 · Florent Bouchard, Alexandre Renaux, Guillaume Ginolhac, Arnaud Breloy

This paper presents a new performance bound for estimation problems where the parameter to estimate lies in a Riemannian manifold (a smooth manifold endowed with a Riemannian metric) and follows a given prior distributio…

Learning to Bound: A Generative Cramér-Rao Bound

2022-03-07 · Hai Victor Habi, Hagit Messer, Yoram Bresler

The Cram\'er-Rao bound (CRB), a well-known lower bound on the performance of any unbiased parameter estimator, has been used to study a wide variety of problems. However, to obtain the CRB, requires an analytical express…

DenoisingEdge DetectionImage Denoising

Bayesian Cramér-Rao Bound Estimation with Score-Based Models

2023-09-28 · Evan Scope Crafts, Xianyang Zhang, Bo Zhao

The Bayesian Cram\'er-Rao bound (CRB) provides a lower bound on the mean square error of any Bayesian estimator under mild regularity conditions. It can be used to benchmark the performance of statistical estimators, and…

Denoising

Recursive Estimation of Dynamic RSS Fields Based on Crowdsourcing and Gaussian Processes

2018-12-21

In this paper, we address the estimation of a time-varying spatial field of received signal strength (RSS) by relying on measurements from randomly placed and not very accurate sensors. We employ a radio propagation mode…

Gaussian Processes

Cramer-Rao Bound for Estimation After Model Selection and its Application to Sparse Vector Estimation

2019-04-15 · Elad Meir, Tirza Routtenberg

In many practical parameter estimation problems, such as coefficient estimation of polynomial regression, the true model is unknown and thus, a model selection step is performed prior to estimation. The data-based model …

Model Selectionparameter estimation