paper-with-me

홈 › Papers

On the nonparametric maximum likelihood estimator for Gaussian location mixture densities with application to Gaussian denoising

2017-12-06 · Sujayam Saha, Adityanand Guntuboyina

We study the Nonparametric Maximum Likelihood Estimator (NPMLE) for estimating Gaussian location mixture densities in $d$-dimensions from independent observations. Unlike usual likelihood-based methods for fitting mixtures, NPMLEs are based on convex optimization. We prove finite sample results on the Hellinger accuracy of every NPMLE. Our results imply, in particular, that every NPMLE achieves near parametric risk (up to logarithmic multiplicative factors) when the true density is a discrete Gaussian mixture without any prior information on the number of mixture components. NPMLEs can naturally be used to yield empirical Bayes estimates of the Oracle Bayes estimator in the Gaussian denoising problem. We prove bounds for the accuracy of the empirical Bayes estimate as an approximation to the Oracle Bayes estimator. Here our results imply that the empirical Bayes estimator performs at nearly the optimal level (up to logarithmic multiplicative factors) for denoising in clustering situations without any prior knowledge of the number of clusters.

📄 PDF Abstract BibTeX arXiv:1712.02009

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDenoising

Similar Papers 제목 키워드 기반

Self-regularizing Property of Nonparametric Maximum Likelihood Estimator in Mixture Models

2020-08-19 · Yury Polyanskiy, Yihong Wu

Introduced by Kiefer and Wolfowitz \cite{KW56}, the nonparametric maximum likelihood estimator (NPMLE) is a widely used methodology for learning mixture odels and empirical Bayes estimation. Sidestepping the non-convexit…

Model Selection

Nonparametric MLE for Gaussian Location Mixtures: Certified Computation and Generic Behavior

2025-03-26 · Yury Polyanskiy, Mark Sellke

We study the nonparametric maximum likelihood estimator $\widehat{\pi}$ for Gaussian location mixtures in one dimension. It has been known since (Lindsay, 1983) that given an $n$-point dataset, this estimator always retu…

2k

Learning Gaussian Mixtures Using the Wasserstein-Fisher-Rao Gradient Flow

2023-01-04 · Yuling Yan, Kaizheng Wang, Philippe Rigollet

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard p…

Nonparametric logistic regression with deep learning

2024-01-23 · Atsutomo Yara, Yoshikazu Terada

Consider the nonparametric logistic regression problem. In the logistic regression, we usually consider the maximum likelihood estimator, and the excess risk is the expectation of the Kullback-Leibler (KL) divergence bet…

Deep Learningregression

Boosting in Univariate Nonparametric Maximum Likelihood Estimation

2021-01-21 · Yunpeng Li, ZhaoHui Ye

Nonparametric maximum likelihood estimation is intended to infer the unknown density distribution while making as few assumptions as possible. To alleviate the over parameterization in nonparametric data fitting, smoothi…