paper-with-me

Papers

Nyström landmark sampling and regularized Christoffel functions

2019-05-29 · Michaël Fanuel, Joachim Schreurs, Johan A. K. Suykens

Selecting diverse and important items, called landmarks, from a large set is a problem of interest in machine learning. As a specific example, in order to deal with large training sets, kernel methods often rely on low rank matrix Nystr\"om approximations based on the selection or sampling of landmarks. In this context, we propose a deterministic and a randomized adaptive algorithm for selecting landmark points within a training data set. These landmarks are related to the minima of a sequence of kernelized Christoffel functions. Beyond the known connection between Christoffel functions and leverage scores, a connection of our method with finite determinantal point processes (DPPs) is also explained. Namely, our construction promotes diversity among important landmark points in a way similar to DPPs. Also, we explain how our randomized adaptive algorithm can influence the accuracy of Kernel Ridge Regression.

📄 PDF Abstract BibTeX arXiv:1905.12346

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityPoint Processes

Similar Papers 제목 키워드 기반

Relating Leverage Scores and Density using Regularized Christoffel Functions

2018-05-21 · NeurIPS 2018 12 · Edouard Pauwels, Francis Bach, Jean-Philippe Vert

Statistical leverage scores emerged as a fundamental tool for matrix sketching and column sampling with applications to low rank approximation, regression, random feature learning and quadrature. Yet, the very nature of …

regression

Analysis of regularized Nyström subsampling for regression functions of low smoothness

2018-06-03 · Shuai Lu, Peter Mathé, Sergiy Pereverzyev Jr

This paper studies a Nystr\"om type subsampling approach to large kernel learning methods in the misspecified case, where the target function is not assumed to belong to the reproducing kernel Hilbert space generated by …

regression

Diversity sampling is an implicit regularization for kernel methods

2020-02-20 · Michaël Fanuel, Joachim Schreurs, Johan A. K. Suykens

Kernel methods have achieved very good performance on large scale regression and classification problems, by using the Nystr\"om method and preconditioning techniques. The Nystr\"om approximation -- based on a subset of …

DiversityPoint Processesregression

Fast DPP Sampling for Nyström with Application to Kernel Methods

2016-03-19 · Chengtao Li, Stefanie Jegelka, Suvrit Sra

The Nystr\"om method has long been popular for scaling up kernel methods. Its theoretical guarantees and empirical performance rely critically on the quality of the landmarks selected. We study landmark selection for Nys…

Point Processesregression

Sampling-based Nyström Approximation and Kernel Quadrature

2023-01-23 · Satoshi Hayakawa, Harald Oberhauser, Terry Lyons

We analyze the Nystr\"om approximation of a positive definite kernel associated with a probability measure. We first prove an improved error bound for the conventional Nystr\"om approximation with i.i.d. sampling and sin…

Learning Theory