paper-with-me

홈 › Papers

Compressive PCA for Low-Rank Matrices on Graphs

2016-02-05 · Nauman Shahid, Nathanael Perraudin, Gilles Puy, Pierre Vandergheynst

We introduce a novel framework for an approxi- mate recovery of data matrices which are low-rank on graphs, from sampled measurements. The rows and columns of such matrices belong to the span of the first few eigenvectors of the graphs constructed between their rows and columns. We leverage this property to recover the non-linear low-rank structures efficiently from sampled data measurements, with a low cost (linear in n). First, a Resrtricted Isometry Property (RIP) condition is introduced for efficient uniform sampling of the rows and columns of such matrices based on the cumulative coherence of graph eigenvectors. Secondly, a state-of-the-art fast low-rank recovery method is suggested for the sampled data. Finally, several efficient, parallel and parameter-free decoders are presented along with their theoretical analysis for decoding the low-rank and cluster indicators for the full data matrix. Thus, we overcome the computational limitations of the standard linear low-rank recovery methods for big datasets. Our method can also be seen as a major step towards efficient recovery of non- linear low-rank structures. For a matrix of size n X p, on a single core machine, our method gains a speed up of $p^2/k$ over Robust Principal Component Analysis (RPCA), where k << p is the subspace dimension. Numerically, we can recover a low-rank matrix of size 10304 X 1000, 100 times faster than Robust PCA.

📄 PDF Abstract BibTeX arXiv:1602.02070

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

A Fast Noniterative Algorithm for Compressive Sensing Using Binary Measurement Matrices

2017-08-11 · Mahsa Lotfi, Mathukumalli Vidyasagar

In this paper we present a new algorithm for compressive sensing that makes use of binary measurement matrices and achieves exact recovery of ultra sparse vectors, in a single pass and without any iterations. Due to its …

AllCompressive Sensing

SpaRCS: Recovering low-rank and sparse matrices from compressive measurements

2011-12-01 · NeurIPS 2011 12 · Andrew E. Waters, Aswin C. Sankaranarayanan, Richard Baraniuk

We consider the problem of recovering a matrix $\mathbf{M}$ that is the sum of a low-rank matrix $\mathbf{L}$ and a sparse matrix $\mathbf{S}$ from a small set of linear measurements of the form $\mathbf{y} = \mathcal{A}…

Compressive SensingMatrix CompletionVideo Compressive Sensing

Estimation of the sample covariance matrix from compressive measurements

2015-12-30 · Farhad Pourkamali-Anaraki

This paper focuses on the estimation of the sample covariance matrix from low-dimensional random projections of data known as compressive measurements. In particular, we present an unbiased estimator to extract the covar…

Tensor Regression Networks with various Low-Rank Tensor Approximations

2017-12-27 · Xingwei Cao, Guillaume Rabusseau

Tensor regression networks achieve high compression rate of neural networks while having slight impact on performances. They do so by imposing low tensor rank structure on the weight matrices of fully connected layers. I…

regression

Compressive Sensing of Signals from a GMM with Sparse Precision Matrices

2014-12-01 · NeurIPS 2014 12 · Jianbo Yang, Xuejun Liao, Minhua Chen, Lawrence Carin

This paper is concerned with compressive sensing of signals drawn from a Gaussian mixture model (GMM) with sparse precision matrices. Previous work has shown: (i) a signal drawn from a given GMM can be perfectly reconstr…

Compressive Sensing