paper-with-me

Papers

Risk Estimation Without Using Stein's Lemma -- Application to Image Denoising

2014-12-06 · Sagar Venkatesh Gubbi, Chandra Sekhar Seelamantula

We address the problem of image denoising in additive white noise without placing restrictive assumptions on its statistical distribution. In the recent literature, specific noise distributions have been considered and correspondingly, optimal denoising techniques have been developed. One of the successful approaches for denoising relies on the notion of unbiased risk estimation, which enables one to obtain a useful substitute for the mean-square error. For the case of additive white Gaussian noise contamination, the risk estimation procedure relies on Stein's lemma. Sophisticated wavelet-based denoising techniques, which are essentially nonlinear, have been developed with the help of the lemma. We show that, for linear, shift-invariant denoisers, it is possible to obtain unbiased risk estimates of the mean-square error without using Stein's lemma. An interesting consequence of this development is that the unbiased risk estimator becomes agnostic to the statistical distribution of the noise. As a proof of principle, we show how the new methodology can be used to optimize the parameters of a simple Gaussian smoother. By locally adapting the parameters of the Gaussian smoother, we obtain a shift-variant smoother, which has a denoising performance (quantified by the improvement in peak signal-to-noise ratio (PSNR)) that is competitive to far more sophisticated methods reported in the literature. The proposed solution exhibits considerable parallelism, which we exploit in a Graphics Processing Unit (GPU) implementation.

📄 PDF Abstract BibTeX arXiv:1412.2210

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingGPUImage DenoisingLEMMA

Similar Papers 제목 키워드 기반

Stein's Lemma for the Reparameterization Trick with Exponential Family Mixtures

2019-10-29 · Wu Lin, Mohammad Emtiyaz Khan, Mark Schmidt

Stein's method (Stein, 1973; 1981) is a powerful tool for statistical applications and has significantly impacted machine learning. Stein's lemma plays an essential role in Stein's method. Previous applications of Stein'…

LEMMA

Lower Bounds for Private Estimation of Gaussian Covariance Matrices under All Reasonable Parameter Regimes

2024-04-26 · Victor S. Portella, Nick Harvey

We prove lower bounds on the number of samples needed to privately estimate the covariance matrix of a Gaussian distribution. Our bounds match existing upper bounds in the widest known setting of parameters. Our analysis…

AllLEMMA

Newton-Stein Method: A Second Order Method for GLMs via Stein's Lemma

2015-12-01 · NeurIPS 2015 12 · Murat A. Erdogdu

We consider the problem of efficiently computing the maximum likelihood estimator in Generalized Linear Models (GLMs)when the number of observations is much larger than the number of coefficients (n > > p > > 1). In this…

LEMMASecond-order methods

Newton-Stein Method: An optimization method for GLMs via Stein's Lemma

2015-11-28 · Murat A. Erdogdu

We consider the problem of efficiently computing the maximum likelihood estimator in Generalized Linear Models (GLMs) when the number of observations is much larger than the number of coefficients ($n \gg p \gg 1$). In t…

LEMMASecond-order methods

SmoothHess: ReLU Network Feature Interactions via Stein's Lemma

2023-09-21 · NeurIPS 2023 11

Several recent methods for interpretability model feature interactions by looking at the Hessian of a neural network. This poses a challenge for ReLU networks, which are piecewise-linear and thus have a zero Hessian almo…