paper-with-me

홈 › Papers

Near-Optimal Coresets of Kernel Density Estimates

2018-02-06 · Jeff M. Phillips, Wai Ming Tai

We construct near-optimal coresets for kernel density estimates for points in $\mathbb{R}^d$ when the kernel is positive definite. Specifically we show a polynomial time construction for a coreset of size $O(\sqrt{d}/\varepsilon\cdot \sqrt{\log 1/\varepsilon} )$, and we show a near-matching lower bound of size $\Omega(\min\{\sqrt{d}/\varepsilon, 1/\varepsilon^2\})$. When $d\geq 1/\varepsilon^2$, it is known that the size of coreset can be $O(1/\varepsilon^2)$. The upper bound is a polynomial-in-$(1/\varepsilon)$ improvement when $d \in [3,1/\varepsilon^2)$ and the lower bound is the first known lower bound to depend on $d$ for this problem. Moreover, the upper bound restriction that the kernel is positive definite is significant in that it applies to a wide-variety of kernels, specifically those most important for machine learning. This includes kernels for information distances and the sinc kernel which can be negative.

📄 PDF Abstract BibTeX arXiv:1802.01751

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Coresets 설명 없음

Similar Papers 제목 키워드 기반

Improved Coresets for Kernel Density Estimates

2017-10-11 · Jeff M. Phillips, Wai Ming Tai

We study the construction of coresets for kernel density estimates. That is we show how to approximate the kernel density estimate described by a large point set with another kernel density estimate with a much smaller p…

A Statistical Perspective on Coreset Density Estimation

2020-11-10 · Paxton Turner, Jingbo Liu, Philippe Rigollet

Coresets have emerged as a powerful tool to summarize data by selecting a small subset of the original observations while retaining most of its information. This approach has led to significant computational speedups but…

Density Estimation

Discrepancy, Coresets, and Sketches in Machine Learning

2019-06-11 · Zohar Karnin, Edo Liberty

This paper defines the notion of class discrepancy for families of functions. It shows that low discrepancy classes admit small offline and streaming coresets. We provide general techniques for bounding the class discrep…

BIG-bench Machine LearningDensity Estimation

Stronger Coreset Bounds for Kernel Density Estimators via Chaining

2023-10-12 · Rainie Bozzai, Thomas Rothvoss

We apply the discrepancy method and a chaining approach to give improved bounds on the coreset complexity of a wide class of kernel functions. Our results give randomized polynomial time algorithms to produce coresets of…

Variational Weighting for Kernel Density Ratios

2023-11-06 · NeurIPS 2023 11 · Sangwoong Yoon, Frank C. Park, Gunsu S Yun, Iljung Kim 외

Kernel density estimation (KDE) is integral to a range of generative and discriminative tasks in machine learning. Drawing upon tools from the multidimensional calculus of variations, we derive an optimal weight function…

Density Estimation