Spectral Properties of Radial Kernels and Clustering in High Dimensions

2019-06-25 · David Cohen-Steiner, Alba Chiara de Vitis

In this paper, we study the spectrum and the eigenvectors of radial kernels for mixtures of distributions in $\mathbb{R}^n$. Our approach focuses on high dimensions and relies solely on the concentration properties of the components in the mixture. We give several results describing of the structure of kernel matrices for a sample drawn from such a mixture. Based on these results, we analyze the ability of kernel PCA to cluster high dimensional mixtures. In particular, we exhibit a specific kernel leading to a simple spectral algorithm for clustering mixtures with possibly common means but different covariance matrices. We show that the minimum angular separation between the covariance matrices that is required for the algorithm to succeed tends to $0$ as $n$ goes to infinity.

📄 PDF Abstract BibTeX arXiv:1906.10583

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringVocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

On the Expressive Power of Kernel Methods and the Efficiency of Kernel Learning by Association Schemes

2019-02-13 · Pravesh K. Kothari, Roi Livni

We study the expressive power of kernel methods and the algorithmic feasibility of multiple kernel learning for a special rich class of kernels. Specifically, we define \emph{Euclidean kernels}, a diverse class that in…

Neurally-plausible radial basis kernels using distributed Fourier embeddings

2026-05-08 · Jakeb Chouinard arxiv

Coherent, continuous spatial representations are critical for synthesizing physical and perceptual phenomena into a single representational space. Radial basis kernels provide a path forward for this type of distributed …

Cluster-based Random Radial Basis Kernel Function for Hyperspectral Data Classification

2024-09-08 · Saeid Niazmardi

Kernel-based classification methods, particularly the support vector machine (SVM), are among the most common algorithms for hyperspectral data classification. The Radial Basis function (RBF) kernel has earned great popu…

Classification

Spectral Clustering with Jensen-type kernels and their multi-point extensions

2014-03-18 · CVPR 2014 6 · Debarghya Ghoshdastidar, Ambedkar Dukkipati, Ajay P. Adsul, Aparna S. Vijayan

Motivated by multi-distribution divergences, which originate in information theory, we propose a notion of `multi-point' kernels, and study their applications. We study a class of kernels based on Jensen type divergences…

Clustering Image Segmentation Semantic Segmentation Vocal Bursts Type Prediction

Learning spectrograms with convolutional spectral kernels

2019-05-23 · Zheyang Shen, Markus Heinonen, Samuel Kaski

We introduce the convolutional spectral kernel (CSK), a novel family of non-stationary, nonparametric covariance kernels for Gaussian process (GP) models, derived from the convolution between two imaginary radial basis f…

Gaussian Processes