paper-with-me

Papers

Fast High-dimensional Kernel Summations Using the Monte Carlo Multipole Method

2008-12-01 · NeurIPS 2008 12 · Dongryeol Lee, Alexander G. Gray

We propose a new fast Gaussian summation algorithm for high-dimensional datasets with high accuracy. First, we extend the original fast multipole-type methods to use approximation schemes with both hard and probabilistic error. Second, we utilize a new data structure called subspace tree which maps each data point in the node to its lower dimensional mapping as determined by any linear dimension reduction method such as PCA. This new data structure is suitable for reducing the cost of each pairwise distance computation, the most dominant cost in many kernel methods. Our algorithm guarantees probabilistic relative error on each kernel sum, and can be applied to high-dimensional Gaussian summations which are ubiquitous inside many kernel methods as the key computational bottleneck. We provide empirical speedup results on low to high-dimensional datasets up to 89 dimensions.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality ReductionVocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Fast Kernel Summation in High Dimensions via Slicing and Fourier Transforms

2024-01-16 · Johannes Hertrich

Kernel-based methods are heavily used in machine learning. However, they suffer from $O(N^2)$ complexity in the number $N$ of considered data points. In this paper, we propose an approximation procedure, which reduces th…

Smoothed Distance Kernels for MMDs and Applications in Wasserstein Gradient Flows

2025-04-10 · Nicolaj Rux, Michael Quellmalz, Gabriele Steidl

Negative distance kernels $K(x,y) := - \|x-y\|$ were used in the definition of maximum mean discrepancies (MMDs) in statistics and lead to favorable numerical results in various applications. In particular, so-called sli…

Fast Summation of Radial Kernels via QMC Slicing

2024-10-02 · Johannes Hertrich, Tim Jahn, Michael Quellmalz

The fast computation of large kernel sums is a challenging task, which arises as a subproblem in any kernel method. We approach the problem by slicing, which relies on random projections to one-dimensional subspaces and …

Far-Field Compression for Fast Kernel Summation Methods in High Dimensions

2014-09-09 · William B. March, George Biros

We consider fast kernel summations in high dimensions: given a large set of points in $d$ dimensions (with $d \gg 3$) and a pair-potential function (the {\em kernel} function), we compute a weighted sum of all pairwise k…

Vocal Bursts Intensity Prediction

Monte Carlo with kernel-based Gibbs measures: Guarantees for probabilistic herding

2024-02-18 · Martin Rouault, Rémi Bardenet, Mylène Maïda

Kernel herding belongs to a family of deterministic quadratures that seek to minimize the worst-case integration error over a reproducing kernel Hilbert space (RKHS). In spite of strong experimental support, it has revea…