Structured Sparse Principal Component Analysis
We present an extension of sparse PCA, or sparse dictionary learning, where the sparsity patterns of all dictionary elements are structured and constrained to belong to a prespecified set of shapes. This \emph{structured sparse PCA} is based on a structured regularization recently introduced by [1]. While classical sparse priors only deal with \textit{cardinality}, the regularization we use encodes higher-order information about the data. We propose an efficient and simple optimization procedure to solve this problem. Experiments with two practical tasks, face recognition and the study of the dynamics of a protein complex, demonstrate the benefits of the proposed structured approach over unstructured approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Dictionary LearningFace RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Do algorithms and barriers for sparse principal component analysis extend to other structured settings?
We study a principal component analysis problem under the spiked Wishart model in which the structure in the signal is captured by a class of union-of-subspace models. This general class includes vanilla sparse PCA as we…
Sparse Principal Component Analysis for High Dimensional Vector Autoregressive Models
We study sparse principal component analysis for high dimensional vector autoregressive time series under a doubly asymptotic framework, which allows the dimension $d$ to scale with the series length $T$. We treat the tr…
Time SeriesTime Series AnalysisVocal Bursts Intensity PredictionFeature Grouping and Sparse Principal Component Analysis with Truncated Regularization
In this paper, we consider a new variant for principal component analysis (PCA), aiming to capture the grouping and/or sparse structures of factor loadings simultaneously. To achieve these goals, we employ a non-convex t…
Dimensionality Reductionfeature selectionPrincipal Basis Analysis in Sparse Representation
This article introduces a new signal analysis method, which can be interpreted as a principal component analysis in sparse decomposition of the signal. The method, called principal basis analysis, is based on a novel cri…
DenoisingImage DenoisingStructured Sparse Principal Components Analysis with the TV-Elastic Net penalty
Principal component analysis (PCA) is an exploratory tool widely used in data analysis to uncover dominant patterns of variability within a population. Despite its ability to represent a data set in a low-dimensional spa…