paper-with-me

Papers

Robust Sub-Gaussian Principal Component Analysis and Width-Independent Schatten Packing

2020-06-12 · NeurIPS 2020 12 · Arun Jambulapati, Jerry Li, Kevin Tian

We develop two methods for the following fundamental statistical task: given an $\epsilon$-corrupted set of $n$ samples from a $d$-dimensional sub-Gaussian distribution, return an approximate top eigenvector of the covariance matrix. Our first robust PCA algorithm runs in polynomial time, returns a $1 - O(\epsilon\log\epsilon^{-1})$-approximate top eigenvector, and is based on a simple iterative filtering approach. Our second, which attains a slightly worse approximation factor, runs in nearly-linear time and sample complexity under a mild spectral gap assumption. These are the first polynomial-time algorithms yielding non-trivial information about the covariance of a corrupted sub-Gaussian distribution without requiring additional algebraic structure of moments. As a key technical tool, we develop the first width-independent solvers for Schatten-$p$ norm packing semidefinite programs, giving a $(1 + \epsilon)$-approximate solution in $O(p\log(\tfrac{nd}{\epsilon})\epsilon^{-1})$ input-sparsity time iterations (where $n$, $d$ are problem dimensions).

📄 PDF Abstract BibTeX arXiv:2006.06980

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Fast Algorithms for Gaussian Noise Invariant Independent Component Analysis

2013-12-01 · NeurIPS 2013 12 · James R. Voss, Luis Rademacher, Mikhail Belkin

The performance of standard algorithms for Independent Component Analysis quickly deteriorates under the addition of Gaussian noise. This is partially due to a common first step that typically consists of whitening, i.e.…

Principal Basis Analysis in Sparse Representation

2015-11-25 · Hong Sun, Cheng-Wei Sang, Chen-Guang Liu

This article introduces a new signal analysis method, which can be interpreted as a principal component analysis in sparse decomposition of the signal. The method, called principal basis analysis, is based on a novel cri…

DenoisingImage Denoising

Gaussian Mixture Models with Component Means Constrained in Pre-selected Subspaces

2015-08-26 · Mu Qiao, Jia Li

We investigate a Gaussian mixture model (GMM) with component means constrained in a pre-selected subspace. Applications to classification and clustering are explored. An EM-type estimation algorithm is derived. We prove …

ClusteringDimensionality ReductionGeneral Classification

Robust Principal Component Analysis Based On Maximum Correntropy Power Iterations

2019-10-24 · Jean P. Chereau, Bruno Scalzo Dees, Danilo P. Mandic

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA …

Task-aware Distributed Source Coding under Dynamic Bandwidth

2023-05-24 · NeurIPS 2023 11 · Po-han Li, Sravan Kumar Ankireddy, Ruihan Zhao, Hossein Nourkhiz Mahjoub 외

Efficient compression of correlated data is essential to minimize communication overload in multi-sensor networks. In such networks, each sensor independently compresses the data and transmits them to a central node due …

Decoderobject-detectionObject Detection