paper-with-me

Papers

oASIS: Adaptive Column Sampling for Kernel Matrix Approximation

2015-05-19 · Raajen Patel, Thomas A. Goldstein, Eva L. Dyer, Azalia Mirhoseini, Richard G. Baraniuk

Kernel matrices (e.g. Gram or similarity matrices) are essential for many state-of-the-art approaches to classification, clustering, and dimensionality reduction. For large datasets, the cost of forming and factoring such kernel matrices becomes intractable. To address this challenge, we introduce a new adaptive sampling algorithm called Accelerated Sequential Incoherence Selection (oASIS) that samples columns without explicitly computing the entire kernel matrix. We provide conditions under which oASIS is guaranteed to exactly recover the kernel matrix with an optimal number of columns selected. Numerical experiments on both synthetic and real-world datasets demonstrate that oASIS achieves performance comparable to state-of-the-art adaptive sampling methods at a fraction of the computational cost. The low runtime complexity of oASIS and its low memory footprint enable the solution of large problems that are simply intractable using other adaptive methods.

📄 PDF Abstract BibTeX arXiv:1505.05208

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDimensionality ReductionGeneral Classification

Similar Papers 제목 키워드 기반

Pack only the essentials: Adaptive dictionary learning for kernel ridge regression

2026-04-24 · Daniele Calandriello, Alessandro Lazaric, Michal Valko arxiv

One of the major limits of kernel ridge regression (KRR) is that storing and manipulating the kernel matrix K_n for n samples requires O(n^2) space, which rapidly becomes unfeasible for large n. Nystrom approximations re…

On the Power of Adaptivity in Matrix Completion and Approximation

2014-07-14 · Akshay Krishnamurthy, Aarti Singh

We consider the related tasks of matrix completion and matrix approximation from missing data and propose adaptive sampling procedures for both problems. We show that adaptive sampling allows one to eliminate standard in…

Matrix Completion

Analysis of Nystrom method with sequential ridge leverage scores

2026-04-22 · Daniele Calandriello, Alessandro Lazaric, Michal Valko arxiv

Large-scale kernel ridge regression (KRR) is limited by the need to store a large kernel matrix K_t. To avoid storing the entire matrix K_t, Nystrom methods subsample a subset of columns of the kernel matrix, and efficie…

High Dimensional Low Rank plus Sparse Matrix Decomposition

2015-02-01 · Mostafa Rahmani, George Atia

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and …

ClusteringSmall Data Image ClassificationVocal Bursts Intensity Prediction

Improving CUR Matrix Decomposition and the Nyström Approximation via Adaptive Sampling

2013-03-18 · Shusen Wang, Zhihua Zhang

The CUR matrix decomposition and the Nystr\"{o}m approximation are two important low-rank matrix approximation techniques. The Nystr\"{o}m method approximates a symmetric positive semidefinite matrix in terms of a small …