paper-with-me

Papers

Relative concentration bounds for the spectrum of kernel matrices

2018-12-05 · Ernesto Araya Valdivia

In this paper we study the concentration properties for the eigenvalues of kernel matrices, which are central objects in a wide range of kernel methods and, more recently, in network analysis. We present a set of concentration inequalities tailored for each individual eigenvalue of the kernel matrix with respect to its known asymptotic limit. The inequalities presented here are of relative type, meaning that they scale with the eigenvalue in consideration, which results in convergence rates that vary across the spectrum. The rates we obtain here are faster than the typical $\O(\frac{1}{\sqrt n})$ and are often exponential, depending on regularity assumptions of Sobolev type. One key feature of our results is that they apply to non positive kernels, which is fundamental in the context of network analysis. We show how our results are well suited for the study of dot product kernels, which are related to random geometric graphs on the sphere, via the graphon formalism. We illustrate our results by applying them to a variety of dot product kernels on the sphere and to the one dimensional Gaussian kernel.

📄 PDF Abstract BibTeX arXiv:1812.02108

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Approximation beats concentration? An approximation view on inference with smooth radial kernels

2018-01-10 · Mikhail Belkin

Positive definite kernels and their associated Reproducing Kernel Hilbert Spaces provide a mathematically compelling and practically competitive framework for learning from data. In this paper we take the approximation…

Spectral Properties of Radial Kernels and Clustering in High Dimensions

2019-06-25 · David Cohen-Steiner, Alba Chiara de Vitis

In this paper, we study the spectrum and the eigenvectors of radial kernels for mixtures of distributions in $\mathbb{R}^n$. Our approach focuses on high dimensions and relies solely on the concentration properties of th…

ClusteringVocal Bursts Intensity Prediction

Simple Relative Deviation Bounds for Covariance and Gram Matrices

2024-10-08 · Daniel Barzilai, Ohad Shamir

We provide non-asymptotic, relative deviation bounds for the eigenvalues of empirical covariance and Gram matrices in general settings. Unlike typical uniform bounds, which may fail to capture the behavior of smaller eig…

Adaptive and Oblivious Randomized Subspace Methods for High-Dimensional Optimization: Sharp Analysis and Lower Bounds

2020-12-13 · Jonathan Lacotte, Mert Pilanci

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximatio…

subspace methods

Concentration inequalities for leave-one-out cross validation

2022-11-04 · Benny Avelin, Lauri Viitasaari

In this article we prove that estimator stability is enough to show that leave-one-out cross validation is a sound procedure, by providing concentration bounds in a general framework. In particular, we provide concentrat…

Density Estimationregression