paper-with-me

홈 › Papers

Efficient Algorithms and Error Analysis for the Modified Nystrom Method

2014-04-01 · Shusen Wang, Zhihua Zhang

Many kernel methods suffer from high time and space complexities and are thus prohibitive in big-data applications. To tackle the computational challenge, the Nystr\"om method has been extensively used to reduce time and space complexities by sacrificing some accuracy. The Nystr\"om method speedups computation by constructing an approximation of the kernel matrix using only a few columns of the matrix. Recently, a variant of the Nystr\"om method called the modified Nystr\"om method has demonstrated significant improvement over the standard Nystr\"om method in approximation accuracy, both theoretically and empirically. In this paper, we propose two algorithms that make the modified Nystr\"om method practical. First, we devise a simple column selection algorithm with a provable error bound. Our algorithm is more efficient and easier to implement than and nearly as accurate as the state-of-the-art algorithm. Second, with the selected columns at hand, we propose an algorithm that computes the approximation in lower time complexity than the approach in the previous work. Furthermore, we prove that the modified Nystr\"om method is exact under certain conditions, and we establish a lower error bound for the modified Nystr\"om method.

📄 PDF Abstract BibTeX arXiv:1404.0138

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Ensemble Nystrom Method

2009-12-01 · NeurIPS 2009 12 · Sanjiv Kumar, Mehryar Mohri, Ameet Talwalkar

A crucial technique for scaling kernel methods to very large data sets reaching or exceeding millions of instances is based on low-rank approximation of kernel matrices. We introduce a new family of algorithms based on m…

regression

Improved Fixed-Rank Nyström Approximation via QR Decomposition: Practical and Theoretical Aspects

2017-08-08 · Farhad Pourkamali-Anaraki, Stephen Becker

The Nystrom method is a popular technique that uses a small number of landmark points to compute a fixed-rank approximation of large kernel matrices that arise in machine learning problems. In practice, to ensure high qu…

Spectral Clustering using Eigenspectrum Shape Based Nystrom Sampling

2020-07-21 · Djallel Bouneffouf

Spectral clustering has shown a superior performance in analyzing the cluster structure. However, its computational complexity limits its application in analyzing large-scale data. To address this problem, many low-rank …

Clustering

Reduced-Set Kernel Principal Components Analysis for Improving the Training and Execution Speed of Kernel Machines

2015-07-26 · Hassan A. Kingravi, Patricio A. Vela, Alexandar Gray

This paper presents a practical, and theoretically well-founded, approach to improve the speed of kernel manifold learning algorithms relying on spectral decomposition. Utilizing recent insights in kernel smoothing and l…

Localization from structured distance matrices via low-rank matrix recovery

2023-11-29 · Samuel Lichtenberg, Abiy Tasissa

We study the problem of determining the configuration of $n$ points by using their distances to $m$ nodes, referred to as anchor nodes. One sampling scheme is Nystrom sampling, which assumes known distances between the a…