paper-with-me

홈 › Papers

Optimal Coreset for Gaussian Kernel Density Estimation

2020-07-15 · Wai Ming Tai

Given a point set $P\subset \mathbb{R}^d$, the kernel density estimate of $P$ is defined as \[ \overline{\mathcal{G}}_P(x) = \frac{1}{\left|P\right|}\sum_{p\in P}e^{-\left\lVert x-p \right\rVert^2} \] for any $x\in\mathbb{R}^d$. We study how to construct a small subset $Q$ of $P$ such that the kernel density estimate of $P$ is approximated by the kernel density estimate of $Q$. This subset $Q$ is called a coreset. The main technique in this work is constructing a $\pm 1$ coloring on the point set $P$ by discrepancy theory and we leverage Banaszczyk's Theorem. When $d>1$ is a constant, our construction gives a coreset of size $O\left(\frac{1}{\varepsilon}\right)$ as opposed to the best-known result of $O\left(\frac{1}{\varepsilon}\sqrt{\log\frac{1}{\varepsilon}}\right)$. It is the first result to give a breakthrough on the barrier of $\sqrt{\log}$ factor even when $d=2$.

📄 PDF Abstract BibTeX arXiv:2007.08031

Code (0)

등록된 구현이 없습니다.

Tasks

Density Estimation

Similar Papers 제목 키워드 기반

A Statistical Perspective on Coreset Density Estimation

2020-11-10 · Paxton Turner, Jingbo Liu, Philippe Rigollet

Coresets have emerged as a powerful tool to summarize data by selecting a small subset of the original observations while retaining most of its information. This approach has led to significant computational speedups but…

Density Estimation

Improved Coresets for Kernel Density Estimates

2017-10-11 · Jeff M. Phillips, Wai Ming Tai

We study the construction of coresets for kernel density estimates. That is we show how to approximate the kernel density estimate described by a large point set with another kernel density estimate with a much smaller p…

Discrepancy, Coresets, and Sketches in Machine Learning

2019-06-11 · Zohar Karnin, Edo Liberty

This paper defines the notion of class discrepancy for families of functions. It shows that low discrepancy classes admit small offline and streaming coresets. We provide general techniques for bounding the class discrep…

BIG-bench Machine LearningDensity Estimation

Near-Optimal Coresets of Kernel Density Estimates

2018-02-06 · Jeff M. Phillips, Wai Ming Tai

We construct near-optimal coresets for kernel density estimates for points in $\mathbb{R}^d$ when the kernel is positive definite. Specifically we show a polynomial time construction for a coreset of size $O(\sqrt{d}/\va…

Scalable Training of Mixture Models via Coresets

2011-12-01 · NeurIPS 2011 12 · Dan Feldman, Matthew Faulkner, Andreas Krause

How can we train a statistical mixture model on a massive data set? In this paper, we show how to construct coresets for mixtures of Gaussians and natural generalizations. A coreset is a weighted subset of the data, whic…

Density Estimation