paper-with-me

홈 › Papers

Cone-Constrained Principal Component Analysis

2014-12-01 · NeurIPS 2014 12 · Yash Deshpande, Andrea Montanari, Emile Richard

Estimating a vector from noisy quadratic observations is a task that arises naturally in many contexts, from dimensionality reduction, to synchronization and phase retrieval problems. It is often the case that additional information is available about the unknown vector (for instance, sparsity, sign or magnitude of its entries). Many authors propose non-convex quadratic optimization problems that aim at exploiting optimally this information. However, solving these problems is typically NP-hard. We consider a simple model for noisy quadratic observation of an unknown vector $\bvz$. The unknown vector is constrained to belong to a cone $\Cone \ni \bvz$. While optimal estimation appears to be intractable for the general problems in this class, we provide evidence that it is tractable when $\Cone$ is a convex cone with an efficient projection. This is surprising, since the corresponding optimization problem is non-convex and --from a worst case perspective-- often NP hard. We characterize the resulting minimax risk in terms of the statistical dimension of the cone $\delta(\Cone)$. This quantity is already known to control the risk of estimation from gaussian observations and random linear measurements. It is rather surprising that the same quantity plays a role in the estimation risk from quadratic measurements.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality ReductionRetrieval

Similar Papers 제목 키워드 기반

Non-Sparse PCA in High Dimensions via Cone Projected Power Iteration

2020-05-15 · Yufei Yi, Matey Neykov

In this paper, we propose a cone projected power iteration algorithm to recover the first principal eigenvector from a noisy positive semidefinite matrix. When the true principal eigenvector is assumed to belong to a con…

Vocal Bursts Intensity Prediction

Disjoint principal component analysis by constrained binary particle swarm optimization

2020-04-22 · John Ramírez-Figueroa, Carlos Martín-Barreiro, Ana B. Nieto-Librero, Victor Leiva-Sánchez 외

In this paper, we propose an alternative method to the disjoint principal component analysis. The method consists of a principal component analysis with constraints, which allows us to determine disjoint components that …

Stochastic Optimization

Overcoming Catastrophic Forgetting via Direction-Constrained Optimization

2020-11-25 · Yunfei Teng, Anna Choromanska, Murray Campbell, Songtao Lu 외

This paper studies a new design of the optimization algorithm for training deep learning models with a fixed architecture of the classification network in a continual learning framework. The training data is non-stationa…

Continual Learning

Autoencoding Improves Pre-trained Word Embeddings

2020-10-25 · COLING 2020 8 · Masahiro Kaneko, Danushka Bollegala

Prior work investigating the geometry of pre-trained word embeddings have shown that word embeddings to be distributed in a narrow cone and by centering and projecting using principal component vectors one can increase t…

Word Embeddings

Sparse PCA With Multiple Components

2022-09-29 · Ryan Cory-Wright, Jean Pauphilet

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner.…