paper-with-me

홈 › Papers

Tensor Sketch: Fast and Scalable Polynomial Kernel Approximation

2025-05-13 · Ninh Pham, Rasmus Pagh

Approximation of non-linear kernels using random feature maps has become a powerful technique for scaling kernel methods to large datasets. We propose $\textit{Tensor Sketch}$, an efficient random feature map for approximating polynomial kernels. Given $n$ training samples in $\mathbb{R}^d$ Tensor Sketch computes low-dimensional embeddings in $\mathbb{R}^D$ in time $\mathcal{O}\left( n(d+D \log{D}) \right)$ making it well-suited for high-dimensional and large-scale settings. We provide theoretical guarantees on the approximation error, ensuring the fidelity of the resulting kernel function estimates. We also discuss extensions and highlight applications where Tensor Sketch serves as a central computational tool.

📄 PDF Abstract BibTeX arXiv:2505.08146

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sketching for Kronecker Product Regression and P-splines

2017-12-27 · Huaian Diao, Zhao Song, Wen Sun, David P. Woodruff

TensorSketch is an oblivious linear sketch introduced in Pagh'13 and later used in Pham, Pagh'13 in the context of SVMs for polynomial kernels. It was shown in Avron, Nguyen, Woodruff'14 that TensorSketch provides a subs…

regression

Complex-to-Real Sketches for Tensor Products with Applications to the Polynomial Kernel

2022-02-04 · Jonas Wacker, Ruben Ohana, Maurizio Filippone

Randomized sketches of a tensor product of $p$ vectors follow a tradeoff between statistical efficiency and computational acceleration. Commonly used approaches avoid computing the high-dimensional tensor product explici…

Fast Sketching of Polynomial Kernels of Polynomial Degree

2021-08-21 · Zhao Song, David P. Woodruff, Zheng Yu, Lichen Zhang

Kernel methods are fundamental in machine learning, and faster algorithms for kernel approximation provide direct speedups for many core tasks in machine learning. The polynomial kernel is especially important as other k…

ARCBIG-bench Machine Learning

The GaussianSketch for Almost Relative Error Kernel Distance

2018-11-09 · Jeff M. Phillips, Wai Ming Tai

We introduce two versions of a new sketch for approximately embedding the Gaussian kernel into Euclidean inner product space. These work by truncating infinite expansions of the Gaussian kernel, and carefully invoking th…

Improved Random Features for Dot Product Kernels

2022-01-21 · Jonas Wacker, Motonobu Kanagawa, Maurizio Filippone

Dot product kernels, such as polynomial and exponential (softmax) kernels, are among the most widely used kernels in machine learning, as they enable modeling the interactions between input features, which is crucial in …

Recommendation Systems