paper-with-me

Papers

Efficient Robust Principal Component Analysis via Block Krylov Iteration and CUR Decomposition

2023-01-01 · CVPR 2023 1 · Shun Fang, Zhengqin Xu, Shiqian Wu, Shoulie Xie

Robust principal component analysis (RPCA) is widely studied in computer vision. Recently an adaptive rank estimate based RPCA has achieved top performance in low-level vision tasks without the prior rank, but both the rank estimate and RPCA optimization algorithm involve singular value decomposition, which requires extremely huge computational resource for large-scale matrices. To address these issues, an efficient RPCA (eRPCA) algorithm is proposed based on block Krylov iteration and CUR decomposition in this paper. Specifically, the Krylov iteration method is employed to approximate the eigenvalue decomposition in the rank estimation, which requires O(ndrq + n(rq)^2) for an (nxd) input matrix, in which q is a parameter with a small value, r is the target rank. Based on the estimated rank, CUR decomposition is adopted to replace SVD in updating low-rank matrix component, whose complexity reduces from O(rnd) to O(r^2n) per iteration. Experimental results verify the efficiency and effectiveness of the proposed eRPCA over the state-of-the-art methods in various low-level vision applications.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Randomized Block Krylov Methods for Stronger and Faster Approximate Singular Value Decomposition

2015-04-21 · NeurIPS 2015 12 · Cameron Musco, Christopher Musco

Since being analyzed by Rokhlin, Szlam, and Tygert and popularized by Halko, Martinsson, and Tropp, randomized Simultaneous Power Iteration has become the method of choice for approximate singular value decomposition. It…

Tutorial: Complexity analysis of Singular Value Decomposition and its variants

2019-06-28 · Xiaocan Li, Shuo Wang, Yinghao Cai

We compared the regular Singular Value Decomposition (SVD), truncated SVD, Krylov method and Randomized PCA, in terms of time and space complexity. It is well-known that Krylov method and Randomized PCA only performs wel…

Towards Efficient and Accurate Approximation: Tensor Decomposition Based on Randomized Block Krylov Iteration

2022-11-27 · Yichun Qiu, Weijun Sun, Guoxu Zhou, Qibin Zhao

Efficient and accurate low-rank approximation (LRA) methods are of great significance for large-scale data analysis. Randomized tensor decompositions have emerged as powerful tools to meet this need, but most existing me…

Data CompressionDenoisingTensor Decomposition

An Improved Frequent Directions Algorithm for Low-Rank Approximation via Block Krylov Iteration

2021-09-24 · Chenhao Wang, Qianxin Yi, Xiuwu Liao, Yao Wang

Frequent Directions, as a deterministic matrix sketching technique, has been proposed for tackling low-rank approximation problems. This method has a high degree of accuracy and practicality, but experiences a lot of com…

Computational Efficiency

Diffusion Approximations for Online Principal Component Estimation and Global Convergence

2018-08-29 · NeurIPS 2017 12 · Chris Junchi Li, Mengdi Wang, Han Liu, Tong Zhang

In this paper, we propose to adopt the diffusion approximation tools to study the dynamics of Oja's iteration which is an online stochastic gradient descent method for the principal component analysis. Oja's iteration ma…