paper-with-me

Papers

Efficient Nonparametric Smoothness Estimation

2016-05-19 · NeurIPS 2016 12 · Shashank Singh, Simon S. Du, Barnabás Póczos

Sobolev quantities (norms, inner products, and distances) of probability density functions are important in the theory of nonparametric statistics, but have rarely been used in practice, partly due to a lack of practical estimators. They also include, as special cases, $L^2$ quantities which are used in many applications. We propose and analyze a family of estimators for Sobolev quantities of unknown probability density functions. We bound the bias and variance of our estimators over finite samples, finding that they are generally minimax rate-optimal. Our estimators are significantly more computationally tractable than previous estimators, and exhibit a statistical/computational trade-off allowing them to adapt to computational constraints. We also draw theoretical connections to recent work on fast two-sample testing. Finally, we empirically validate our estimators on synthetic data.

📄 PDF Abstract BibTeX arXiv:1605.05785

Code (1)

sss1/SobolevEstimation 공식 구현

Tasks

Two-sample testing

Similar Papers 제목 키워드 기반

Beyond Smoothness: Incorporating Low-Rank Analysis into Nonparametric Density Estimation

2022-04-02 · NeurIPS 2021 12 · Robert A. Vandermeulen, Antoine Ledent

The construction and theoretical analysis of the most popular universally consistent nonparametric density estimators hinge on one functional property: smoothness. In this paper we investigate the theoretical implication…

Density Estimation

Nonparametric Instrumental Variable Regression with Observed Covariates

2025-11-24 · Zikai Shen, Zonghao Chen, Dimitri Meunier, Ingo Steinwart 외 arxiv

We study the problem of nonparametric instrumental variable regression with observed covariates, which we refer to as NPIV-O. Compared with standard nonparametric instrumental variable regression (NPIV), the additional o…

Causal Inference

Gradient-free stochastic optimization for additive models

2025-03-03 · Arya Akhavan, Alexandre B. Tsybakov

We address the problem of zero-order optimization from noisy observations for an objective function satisfying the Polyak-{\L}ojasiewicz or the strong convexity condition. Additionally, we assume that the objective funct…

Additive modelsStochastic Optimization

Nonparametric Density Estimation under Adversarial Losses

2018-05-22 · NeurIPS 2018 12 · Shashank Singh, Ananya Uppal, Boyue Li, Chun-Liang Li 외

We study minimax convergence rates of nonparametric density estimation under a large class of loss functions called "adversarial losses", which, besides classical $\mathcal{L}^p$ losses, includes maximum mean discrepancy…

Density Estimation

Nonparametric Estimation of Renyi Divergence and Friends

2014-02-12 · Akshay Krishnamurthy, Kirthevasan Kandasamy, Barnabas Poczos, Larry Wasserman

We consider nonparametric estimation of $L_2$, Renyi-$\alpha$ and Tsallis-$\alpha$ divergences between continuous distributions. Our approach is to construct estimators for particular integral functionals of two densitie…