paper-with-me

Papers

Memory Efficient And Minimax Distribution Estimation Under Wasserstein Distance Using Bayesian Histograms

2023-07-19 · Peter Matthew Jacobs, Lekha Patel, Anirban Bhattacharya, Debdeep Pati

We study Bayesian histograms for distribution estimation on $[0,1]^d$ under the Wasserstein $W_v, 1 \leq v < \infty$ distance in the i.i.d sampling regime. We newly show that when $d < 2v$, histograms possess a special \textit{memory efficiency} property, whereby in reference to the sample size $n$, order $n^{d/2v}$ bins are needed to obtain minimax rate optimality. This result holds for the posterior mean histogram and with respect to posterior contraction: under the class of Borel probability measures and some classes of smooth densities. The attained memory footprint overcomes existing minimax optimal procedures by a polynomial factor in $n$; for example an $n^{1 - d/2v}$ factor reduction in the footprint when compared to the empirical measure, a minimax estimator in the Borel probability measure class. Additionally constructing both the posterior mean histogram and the posterior itself can be done super--linearly in $n$. Due to the popularity of the $W_1,W_2$ metrics and the coverage provided by the $d < 2v$ case, our results are of most practical interest in the $(d=1,v =1,2), (d=2,v=2), (d=3,v=2)$ settings and we provide simulations demonstrating the theory in several of these instances.

📄 PDF Abstract BibTeX arXiv:2307.10099

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Minimax Distribution Estimation in Wasserstein Distance

2018-02-24 · Shashank Singh, Barnabás Póczos

The Wasserstein metric is an important measure of distance between probability distributions, with applications in machine learning, statistics, probability theory, and data analysis. This paper provides upper and lower …

BIG-bench Machine Learning

Robust W-GAN-Based Estimation Under Wasserstein Contamination

2021-01-20 · Zheng Liu, Po-Ling Loh

Robust estimation is an important problem in statistics which aims at providing a reasonable estimator when the data-generating distribution lies within an appropriately defined ball around an uncontaminated distribution…

regression

Statistical Estimation Under Distribution Shift: Wasserstein Perturbations and Minimax Theory

2023-08-03 · Patrick Chao, Edgar Dobriban

Distribution shifts are a serious concern in modern statistical learning as they can systematically change the properties of the data away from the truth. We focus on Wasserstein distribution shifts, where every data poi…

Density Estimationregression

Local moment matching: A unified methodology for symmetric functional estimation and distribution estimation under Wasserstein distance

2018-02-23 · Yanjun Han, Jiantao Jiao, Tsachy Weissman

We present \emph{Local Moment Matching (LMM)}, a unified methodology for symmetric functional estimation and distribution estimation under Wasserstein distance. We construct an efficiently computable estimator that achie…

Robust Estimation under the Wasserstein Distance

2023-02-02 · Sloan Nietert, Rachel Cummings, Ziv Goldfeld

We study the problem of robust distribution estimation under the Wasserstein distance, a popular discrepancy measure between probability distributions rooted in optimal transport (OT) theory. Given $n$ samples from an un…

Generative Adversarial Network