paper-with-me

Papers

Provable Inductive Robust PCA via Iterative Hard Thresholding

2017-04-02 · U. N. Niranjan, Arun Rajkumar, Theja Tulabandhula

The robust PCA problem, wherein, given an input data matrix that is the superposition of a low-rank matrix and a sparse matrix, we aim to separate out the low-rank and sparse components, is a well-studied problem in machine learning. One natural question that arises is that, as in the inductive setting, if features are provided as input as well, can we hope to do better? Answering this in the affirmative, the main goal of this paper is to study the robust PCA problem while incorporating feature information. In contrast to previous works in which recovery guarantees are based on the convex relaxation of the problem, we propose a simple iterative algorithm based on hard-thresholding of appropriate residuals. Under weaker assumptions than previous works, we prove the global convergence of our iterative procedure; moreover, it admits a much faster convergence rate and lesser computational complexity per iteration. In practice, through systematic synthetic and real data simulations, we confirm our theoretical findings regarding improvements obtained by using feature information.

📄 PDF Abstract BibTeX arXiv:1704.00367

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

IHT dies hard: Provable accelerated Iterative Hard Thresholding

2017-12-26 · Rajiv Khanna, Anastasios Kyrillidis

We study --both in theory and practice-- the use of momentum motions in classic iterative hard thresholding (IHT) methods. By simply modifying plain IHT, we investigate its convergence behavior on convex optimization cri…

Iterative Hard Thresholding for Low CP-rank Tensor Models

2019-08-22 · Rachel Grotheer, Shuang Li, Anna Ma, Deanna Needell 외

Recovery of low-rank matrices from a small number of linear measurements is now well-known to be possible under various model assumptions on the measurements. Such results demonstrate robustness and are backed with prova…

Between hard and soft thresholding: optimal iterative thresholding algorithms

2018-04-24 · Haoyang Liu, Rina Foygel Barber

Iterative thresholding algorithms seek to optimize a differentiable objective function over a sparsity or rank constraint by alternating between gradient steps that reduce the objective, and thresholding steps that enfor…

On Iterative Hard Thresholding Methods for High-dimensional M-Estimation

2014-10-20 · NeurIPS 2014 12 · Prateek Jain, Ambuj Tewari, Purushottam Kar

The use of M-estimators in generalized linear regression models in high dimensional settings requires risk minimization with hard $L_0$ constraints. Of the known methods, the class of projected gradient descent (also kno…

regressionVocal Bursts Intensity Prediction

NOODL: Provable Online Dictionary Learning and Sparse Coding

2019-02-28 · Sirisha Rambhatla, Xingguo Li, Jarvis Haupt

We consider the dictionary learning problem, where the aim is to model the given data as a linear combination of a few columns of a matrix known as a dictionary, where the sparse weights forming the linear combination ar…

Dictionary Learning