paper-with-me

홈 › Papers

Nonlinear matrix recovery using optimization on the Grassmann manifold

2021-09-13 · Florentin Goyens, Coralia Cartis, Armin Eftekhari

We investigate the problem of recovering a partially observed high-rank matrix whose columns obey a nonlinear structure such as a union of subspaces, an algebraic variety or grouped in clusters. The recovery problem is formulated as the rank minimization of a nonlinear feature map applied to the original matrix, which is then further approximated by a constrained non-convex optimization problem involving the Grassmann manifold. We propose two sets of algorithms, one arising from Riemannian optimization and the other as an alternating minimization scheme, both of which include first- and second-order variants. Both sets of algorithms have theoretical guarantees. In particular, for the alternating minimization, we establish global convergence and worst-case complexity bounds. Additionally, using the Kurdyka-Lojasiewicz property, we show that the alternating minimization converges to a unique limit point. We provide extensive numerical results for the recovery of union of subspaces and clustering under entry sampling and dense Gaussian sampling. Our methods are competitive with existing approaches and, in particular, high accuracy is achieved in the recovery using Riemannian second-order methods.

📄 PDF Abstract BibTeX arXiv:2109.06095

Code (1)

flgoyens/nonlinear-matrix-recovery 공식 구현

Tasks

Riemannian optimizationSecond-order methods

Similar Papers 제목 키워드 기반

Differential Evolution for Grassmann Manifold Optimization: A Projection Approach

2025-03-27 · Andrew Lesniewski

We propose a novel evolutionary algorithm for optimizing real-valued objective functions defined on the Grassmann manifold Gr}(k,n), the space of all k-dimensional linear subspaces of R^n. While existing optimization tec…

Riemannian optimization

Scaled Gradients on Grassmann Manifolds for Matrix Completion

2012-12-01 · NeurIPS 2012 12 · Thanh Ngo, Yousef Saad

This paper describes gradient methods based on a scaled metric on the Grassmann manifold for low-rank matrix completion. The proposed methods significantly improve canonical gradient methods especially on ill-conditioned…

Low-Rank Matrix CompletionMatrix Completion

Grassmann Iterative Linear Discriminant Analysis with Proxy Matrix Optimization

2021-04-16 · Navya Nagananda, Breton Minnehan, Andreas Savakis

Linear Discriminant Analysis (LDA) is commonly used for dimensionality reduction in pattern recognition and statistics. It is a supervised method that aims to find the most discriminant space of reduced dimension that ca…

Dimensionality Reduction

Grassmannian diffusion maps based dimension reduction and classification for high-dimensional data

2020-09-16 · K. R. M. dos Santos, D. G. Giovanis, M. D. Shields

This work introduces the Grassmannian Diffusion Maps, a novel nonlinear dimensionality reduction technique that defines the affinity between points through their representation as low-dimensional subspaces corresponding …

ClusteringDimensionality ReductionFace RecognitionGeneral Classification+1

Adaptive Stochastic Gradient Descent on the Grassmannian for Robust Low-Rank Subspace Recovery and Clustering

2014-12-12 · Jun He, Yue Zhang

In this paper, we present GASG21 (Grassmannian Adaptive Stochastic Gradient for $L_{2,1}$ norm minimization), an adaptive stochastic gradient algorithm to robustly recover the low-rank subspace from a large matrix. In th…

ClusteringStochastic Optimization