paper-with-me

Papers

Even Faster Kernel Matrix Linear Algebra via Density Estimation

2025-10-02 · Rikhav Shah, Sandeep Silwal, Haike Xu arxiv

This paper studies the use of kernel density estimation (KDE) for linear algebraic tasks involving the kernel matrix of a collection of $n$ data points in $\mathbb R^d$. In particular, we improve upon existing algorithms for computing the following up to $(1+\varepsilon)$ relative error: matrix-vector products, matrix-matrix products, the spectral norm, and sum of all entries. The runtimes of our algorithms depend on the dimension $d$, the number of points $n$, and the target error $\varepsilon$. Importantly, the dependence on $n$ in each case is far lower when accessing the kernel matrix through KDE queries as opposed to reading individual entries. Our improvements over existing best algorithms (particularly those of Backurs, Indyk, Musco, and Wagner '21) for these tasks reduce the polynomial dependence on $\varepsilon$, and additionally decreases the dependence on $n$ in the case of computing the sum of all entries of the kernel matrix. We complement our upper bounds with several lower bounds for related problems, which provide (conditional) quadratic time hardness results and additionally hint at the limits of KDE based approaches for the problems we study.

📄 PDF Abstract BibTeX arXiv:2510.02540

Code (0)

등록된 구현이 없습니다.

Tasks

Density Estimation

Similar Papers 제목 키워드 기반

Faster Kernel Matrix Algebra via Density Estimation

2021-02-16 · Arturs Backurs, Piotr Indyk, Cameron Musco, Tal Wagner

We study fast algorithms for computing fundamental properties of a positive semidefinite kernel matrix $K \in \mathbb{R}^{n \times n}$ corresponding to $n$ points $x_1,\ldots,x_n \in \mathbb{R}^d$. In particular, we cons…

Density Estimation

Sublinear Time Numerical Linear Algebra for Structured Matrices

2019-12-12 · Xiaofei Shi, David P. Woodruff

We show how to solve a number of problems in numerical linear algebra, such as least squares regression, $\ell_p$-regression for any $p \geq 1$, low rank approximation, and kernel regression, in time $T(A) \poly(\log(nd)…

regression

Multiresolution kernel matrix algebra

2022-11-21 · H. Harbrecht, M. Multerer, O. Schenk, Ch. Schwab

We propose a sparse algebra for samplet compressed kernel matrices, to enable efficient scattered data analysis. We show the compression of kernel matrices by means of samplets produces optimally sparse matrices in a cer…

Faster Kernel Interpolation for Gaussian Processes

2021-01-28 · Mohit Yadav, Daniel Sheldon, Cameron Musco

A key challenge in scaling Gaussian Process (GP) regression to massive datasets is that exact inference requires computation with a dense n x n kernel matrix, where n is the number of data points. Significant work focuse…

Gaussian Processesregression

Communication-Avoiding Linear Algebraic Kernel K-Means on GPUs

2026-01-23 · Julian Bellavita, Matthew Rubino, Nakul Iyer, Andrew Chang 외 arxiv

Clustering is an important tool in data analysis, with K-means being popular for its simplicity and versatility. However, it cannot handle non-linearly separable clusters. Kernel K-means addresses this limitation but req…