paper-with-me

홈 › Papers

Principal Component Analysis in Space Forms

2023-01-06 · Puoya Tabaghi, Michael Khanzadeh, Yusu Wang, Sivash Mirarab

Principal Component Analysis (PCA) is a workhorse of modern data science. While PCA assumes the data conforms to Euclidean geometry, for specific data types, such as hierarchical and cyclic data structures, other spaces are more appropriate. We study PCA in space forms; that is, those with constant curvatures. At a point on a Riemannian manifold, we can define a Riemannian affine subspace based on a set of tangent vectors. Finding the optimal low-dimensional affine subspace for given points in a space form amounts to dimensionality reduction. Our Space Form PCA (SFPCA) seeks the affine subspace that best represents a set of manifold-valued points with the minimum projection cost. We propose proper cost functions that enjoy two properties: (1) their optimal affine subspace is the solution to an eigenequation, and (2) optimal affine subspaces of different dimensions form a nested set. These properties provide advances over existing methods, which are mostly iterative algorithms with slow convergence and weaker theoretical guarantees. We evaluate the proposed SFPCA on real and simulated data in spherical and hyperbolic spaces. We show that it outperforms alternative methods in estimating true subspaces (in simulated data) with respect to convergence speed or accuracy, often both.

📄 PDF Abstract BibTeX arXiv:2301.02750

Code (1)

HazyResearch/HoroPCA 공식 구현 pytorch

Tasks

Dimensionality ReductionForm

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Kernel principal component analysis network for image classification

2015-12-20 · Dan Wu, Jiasong Wu, Rui Zeng, Longyu Jiang 외

In order to classify the nonlinear feature with linear classifier and improve the classification accuracy, a deep learning network named kernel principal component analysis network (KPCANet) is proposed. First, mapping t…

ClassificationFace RecognitionGeneral Classificationimage-classification+2

A Dual Formulation for Probabilistic Principal Component Analysis

2023-07-19 · Henri De Plaen, Johan A. K. Suykens

In this paper, we characterize Probabilistic Principal Component Analysis in Hilbert spaces and demonstrate how the optimal solution admits a representation in dual space. This allows us to develop a generative framework…

A Framework for Private Matrix Analysis

2020-09-06 · Jalaj Upadhyay, Sarvagya Upadhyay

We study private matrix analysis in the sliding window model where only the last $W$ updates to matrices are considered useful for analysis. We give first efficient $o(W)$ space differentially private algorithms for spec…

Localized Sparse Principal Component Analysis of Multivariate Time Series in Frequency Domain

2024-08-15 · Jamshid Namdari, Amita Manatunga, Fabio Ferrarelli, Robert Krafty

Principal component analysis has been a main tool in multivariate analysis for estimating a low dimensional linear subspace that explains most of the variability in the data. However, in high-dimensional regimes, naive e…

EEGTime Series

R 1 -PCA: Rotational Invariant L 1 -norm Principal Component Analysis for Robust Subspace Factorization

2006-06-01 · ICML '06: Proceedings of the 23rd international conference on Machine learningJune 2006 Pages 281–288 2006 6 · Chris Ding ,Ding Zhou ,Xiaofeng He ,Hongyuan Zha

Principal component analysis (PCA) mini- mizes the sum of squared errors (L 2 -norm) and is sensitive to the presence of outliers. We propose a rotational invariant L 1 -norm PCA (R 1 -PCA). R 1 -PCA is similar to PC…

Clustering