paper-with-me

홈 › Papers

Regularized Optimization on Grassmann Manifold: Theory, Algorithm and Applications

2026-07-23 · Zhuan Liang, Zheng Zhai arxiv

Spectral methods are among the most widely used techniques for community detection, clustering, and graph learning. Their performance, however, critically depends on the accurate estimation of the underlying spectral subspace and can deteriorate substantially in the presence of noise, outliers, or model perturbations. To address this limitation, we propose a Regularized Projection Matrix Approximation (RPMA) framework for robust estimation of rank-$K$ projection matrices. RPMA extends classical spectral projection by incorporating a regularization term, producing projection estimates that are more robust, sparse, and interpretable. We formulate the proposed model as an optimization problem on the manifold of rank-$K$ projection matrices and exploit its geometric equivalence to the Grassmann manifold. Based on this manifold characterization, we derive the first- and second-order optimality conditions, establish the local stability of the regularized leading eigenspace, and characterize the stability of the critical-point landscape under sufficiently small regularization. To efficiently solve the resulting nonconvex optimization problem, we develop a Riemannian gradient projection algorithm with backtracking line search, together with a more efficient Cayley--Sherman--Morrison--Woodbury (Cayley--SMW) gradient method that avoids repeated eigendecompositions. Extensive experiments on both synthetic and real-world datasets demonstrate that RPMA substantially improves the recovery accuracy of projection matrices and consistently outperforms conventional spectral projection methods for community detection and clustering under noisy environments.

📄 PDF Abstract BibTeX arXiv:2607.21039

Code (0)

등록된 구현이 없습니다.

Tasks

Community DetectionGraph Learning

Similar Papers 제목 키워드 기반

Subspace Tracking with Dynamical Models on the Grassmannian

2024-02-15 · Alex Saad-Falcon, Brighton Ancelin, Justin Romberg

Tracking signals in dynamic environments presents difficulties in both analysis and implementation. In this work, we expand on a class of subspace tracking algorithms which utilize the Grassmann manifold -- the set of li…

Manifold Regularization for SIR with Rate Root-n Convergence

2009-12-01 · NeurIPS 2009 12 · Wei Bian, DaCheng Tao

In this paper, we study the manifold regularization for the Sliced Inverse Regression (SIR). The manifold regularization improves the standard SIR in two aspects: 1) it encodes the local geometry for SIR and 2) it enable…

regression

Differential Evolution for Grassmann Manifold Optimization: A Projection Approach

2025-03-27 · Andrew Lesniewski

We propose a novel evolutionary algorithm for optimizing real-valued objective functions defined on the Grassmann manifold Gr}(k,n), the space of all k-dimensional linear subspaces of R^n. While existing optimization tec…

Riemannian optimization

Dimensionality Reduction on Grassmannian via Riemannian Optimization: A Generalized Perspective

2017-11-17 · Tianci Liu, Zelin Shi, Yun-Peng Liu

This paper proposes a generalized framework with joint normalization which learns lower-dimensional subspaces with maximum discriminative power by making use of the Riemannian geometry. In particular, we model the simila…

Dimensionality ReductionRiemannian optimization

Locality Preserving Projections for Grassmann manifold

2017-04-27 · Boyue Wang, Yongli Hu, Junbin Gao, Yanfeng Sun 외

Learning on Grassmann manifold has become popular in many computer vision tasks, with the strong capability to extract discriminative information for imagesets and videos. However, such learning algorithms particularly o…

ClusteringDimensionality Reduction