paper-with-me

홈 › Papers

Self-Expressive Decompositions for Matrix Approximation and Clustering

2015-05-04 · Eva L. Dyer, Tom A. Goldstein, Raajen Patel, Konrad P. Kording, Richard G. Baraniuk

Data-aware methods for dimensionality reduction and matrix decomposition aim to find low-dimensional structure in a collection of data. Classical approaches discover such structure by learning a basis that can efficiently express the collection. Recently, "self expression", the idea of using a small subset of data vectors to represent the full collection, has been developed as an alternative to learning. Here, we introduce a scalable method for computing sparse SElf-Expressive Decompositions (SEED). SEED is a greedy method that constructs a basis by sequentially selecting incoherent vectors from the dataset. After forming a basis from a subset of vectors in the dataset, SEED then computes a sparse representation of the dataset with respect to this basis. We develop sufficient conditions under which SEED exactly represents low rank matrices and vectors sampled from a unions of independent subspaces. We show how SEED can be used in applications ranging from matrix approximation and denoising to clustering, and apply it to numerous real-world datasets. Our results demonstrate that SEED is an attractive low-complexity alternative to other sparse matrix factorization approaches such as sparse PCA and self-expressive methods for clustering.

📄 PDF Abstract BibTeX arXiv:1505.00824

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDenoisingDimensionality Reduction

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Deep Double Self-Expressive Subspace Clustering

2023-06-20 · Ling Zhao, Yunpeng Ma, Shanxiong Chen, Jun Zhou

Deep subspace clustering based on auto-encoder has received wide attention. However, most subspace clustering based on auto-encoder does not utilize the structural information in the self-expressive coefficient matrix, w…

ClusteringContrastive Learning

Doubly Stochastic Subspace Clustering

2020-11-30 · Derek Lim, René Vidal, Benjamin D. Haeffele

Many state-of-the-art subspace clustering methods follow a two-step process by first constructing an affinity matrix between data points and then applying spectral clustering to this affinity. Most of the research into t…

ClusteringImage Clustering

Maximum Entropy Subspace Clustering Network

2020-12-06 · Zhihao Peng, Yuheng Jia, Hui Liu, Junhui Hou 외

Deep subspace clustering networks have attracted much attention in subspace clustering, in which an auto-encoder non-linearly maps the input data into a latent space, and a fully connected layer named self-expressiveness…

Clustering

Sublinear Time and Space Algorithms for Correlation Clustering via Sparse-Dense Decompositions

2021-09-29 · Sepehr Assadi, Chen Wang

We present a new approach for solving (minimum disagreement) correlation clustering that results in sublinear algorithms with highly efficient time and space complexity for this problem. In particular, we obtain the foll…

Clustering

Regression-aware decompositions

2017-10-11 · Mark Tygert

Linear least-squares regression with a "design" matrix A approximates a given matrix B via minimization of the spectral- or Frobenius-norm discrepancy ||AX-B|| over every conformingly sized matrix X. Another popular appr…

Dimensionality Reductionregression