paper-with-me

Papers

Fast Eigenspace Approximation using Random Signals

2016-11-03 · Johan Paratte, Lionel Martin

We focus in this work on the estimation of the first $k$ eigenvectors of any graph Laplacian using filtering of Gaussian random signals. We prove that we only need $k$ such signals to be able to exactly recover as many of the smallest eigenvectors, regardless of the number of nodes in the graph. In addition, we address key issues in implementing the theoretical concepts in practice using accurate approximated methods. We also propose fast algorithms both for eigenspace approximation and for the determination of the $k$th smallest eigenvalue $\lambda_k$. The latter proves to be extremely efficient under the assumption of locally uniform distribution of the eigenvalue over the spectrum. Finally, we present experiments which show the validity of our method in practice and compare it to state-of-the-art methods for clustering and visualization both on synthetic small-scale datasets and larger real-world problems of millions of nodes. We show that our method allows a better scaling with the number of nodes than all previous methods while achieving an almost perfect reconstruction of the eigenspace formed by the first $k$ eigenvectors.

📄 PDF Abstract BibTeX arXiv:1611.00938

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

Constructing fast approximate eigenspaces with application to the fast graph Fourier transforms

2020-02-22 · Cristian Rusu, Lorenzo Rosasco

We investigate numerically efficient approximations of eigenspaces associated to symmetric and general matrices. The eigenspaces are factored into a fixed number of fundamental components that can be efficiently manipula…

Reconstructing undirected graphs from eigenspaces

2016-03-26 · Yohann De Castro, Thibault Espinasse, Paul Rochet

In this paper, we aim at recovering an undirected weighted graph of $N$ vertices from the knowledge of a perturbed version of the eigenspaces of its adjacency matrix $W$. For instance, this situation arises for stationar…

Geometric bias in eigenspace perturbation under random heterogeneous noise

2026-06-09 · Fengkai Liu, Ke Wang, Wanjie Wang arxiv

Spectral methods rely fundamentally on the stability of principal eigenspaces under random perturbations. Classically, this stability is quantified by the Davis-Kahan and Wedin theorems, which bound the eigenspace error …

Low Rank Approximation for Smoothing Spline via Eigensystem Truncation

2019-11-23 · Danqing Xu, Yuedong Wang

Smoothing splines provide a powerful and flexible means for nonparametric estimation and inference. With a cubic time complexity, fitting smoothing spline models to large data is computationally prohibitive. In this pape…

EoRA: Training-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation

2024-10-28 · Shih-Yang Liu, Huck Yang, Chien-Yi Wang, Nai Chit Fung 외

In this work, we re-formulate the model compression problem into the customized compensation problem: Given a compressed model, we aim to introduce residual low-rank paths to compensate for compression errors under custo…

ARCMathModel CompressionQuantization+1