paper-with-me

Papers

Group Projected Subspace Pursuit for Block Sparse Signal Reconstruction: Convergence Analysis and Applications

2024-06-01 · Roy Y. He, Haixia Liu, Hao liu

In this paper, we present a convergence analysis of the Group Projected Subspace Pursuit (GPSP) algorithm proposed by He et al. [HKL+23] (Group Projected subspace pursuit for IDENTification of variable coefficient differential equations (GP-IDENT), Journal of Computational Physics, 494, 112526) and extend its application to general tasks of block sparse signal recovery. We prove that when the sampling matrix satisfies the Block Restricted Isometry Property (BRIP) with a sufficiently small Block Restricted Isometry Constant (BRIC), GPSP exactly recovers the true block sparse signals. When the observations are noisy, this convergence property of GPSP remains valid if the magnitude of true signal is sufficiently large. GPSP selects the features by subspace projection criterion (SPC) for candidate inclusion and response magnitude criterion (RMC) for candidate exclusion. We compare these criteria with counterparts of other state-of-the-art greedy algorithms. Our theoretical analysis and numerical ablation studies reveal that SPC is critical to the superior performances of GPSP, and that RMC can enhance the robustness of feature identification when observations contain noises. We test and compare GPSP with other methods in diverse settings, including heterogeneous random block matrices, inexact observations, face recognition, and PDE identification. We find that GPSP outperforms the other algorithms in most cases for various levels of block sparsity and block sizes, justifying its effectiveness for general applications.

📄 PDF Abstract BibTeX arXiv:2407.07707

Code (2)

RoyYuchenHe/BlockSparse 공식 구현
Recognito-Vision/Face-SDK-Linux-Demos

Tasks

Face Recognition

Similar Papers 제목 키워드 기반

Correlation Adaptive Subspace Segmentation by Trace Lasso

2015-01-18 · Canyi Lu, Jiashi Feng, Zhouchen Lin, Shuicheng Yan

This paper studies the subspace segmentation problem. Given a set of data points drawn from a union of subspaces, the goal is to partition them into their underlying subspaces they were drawn from. The spectral clusterin…

ClusteringSegmentation

Theory of matching pursuit

2008-12-01 · NeurIPS 2008 12 · Zakria Hussain, John S. Shawe-Taylor

We analyse matching pursuit for kernel principal components analysis by proving that the sparse subspace it produces is a sample compression scheme. We show that this bound is tighter than the KPCA bound of Shawe-Taylor …

Innovation Pursuit: A New Approach to Subspace Clustering

2015-12-02 · Mostafa Rahmani, George Atia

In subspace clustering, a group of data points belonging to a union of subspaces are assigned membership to their respective subspaces. This paper presents a new approach dubbed Innovation Pursuit (iPursuit) to the probl…

ClusteringFace Clustering

Restricted Connection Orthogonal Matching Pursuit For Sparse Subspace Clustering

2019-05-01 · Wenqi Zhu, Yuesheng Zhu, Li Zhong, Shuai Yang

Sparse Subspace Clustering (SSC) is one of the most popular methods for clustering data points into their underlying subspaces. However, SSC may suffer from heavy computational burden. Orthogonal Matching Pursuit applied…

Clustering

Projection pursuit based on Gaussian mixtures and evolutionary algorithms

2019-12-27 · Luca Scrucca, Alessio Serafini

We propose a projection pursuit (PP) algorithm based on Gaussian mixture models (GMMs). The negentropy obtained from a multivariate density estimated by GMMs is adopted as the PP index to be maximised. For a fixed dimens…

Density EstimationEvolutionary Algorithms