paper-with-me

Papers

Robust and Differentially Private Principal Component Analysis

2025-07-21 · Minwoo Kim, Sungkyu Jung arxiv

Recent advances have sparked significant interest in the development of privacy-preserving Principal Component Analysis (PCA). However, many existing approaches rely on restrictive assumptions, such as assuming sub-Gaussian data or being vulnerable to data contamination. Additionally, some methods are computationally expensive or depend on unknown model parameters that must be estimated, limiting their accessibility for data analysts seeking privacy-preserving PCA. In this paper, we propose a differentially private PCA method applicable to heavy-tailed and potentially contaminated data. Our approach leverages the property that the covariance matrix of properly rescaled data preserves eigenvectors and their order under elliptical distributions, which include Gaussian and heavy-tailed distributions. By applying a bounded transformation, we enable straightforward computation of principal components in a differentially private manner. Additionally, boundedness guarantees robustness against data contamination. We conduct both theoretical analysis and empirical evaluations of the proposed method, focusing on its ability to recover the subspace spanned by the leading principal components. Extensive numerical experiments demonstrate that our method consistently outperforms existing approaches in terms of statistical utility, particularly in non-Gaussian or contaminated data settings.

📄 PDF Abstract BibTeX arXiv:2507.15232

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Framework for Private Matrix Analysis

2020-09-06 · Jalaj Upadhyay, Sarvagya Upadhyay

We study private matrix analysis in the sliding window model where only the last $W$ updates to matrices are considered useful for analysis. We give first efficient $o(W)$ space differentially private algorithms for spec…

Differentially Private Low-dimensional Synthetic Data from High-dimensional Datasets

2023-05-26 · Yiyun He, Thomas Strohmer, Roman Vershynin, Yizhe Zhu

Differentially private synthetic data provide a powerful mechanism to enable data analysis while protecting sensitive information about individuals. However, when the data lie in a high-dimensional space, the accuracy of…

Differentially Private Sliced Inverse Regression: Minimax Optimality and Algorithm

2024-01-16 · Xintao Xia, Linjun Zhang, Zhanrui Cai

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utiliz…

Dimensionality Reductionregression

Near-optimal Differentially Private Principal Components

2012-12-01 · NeurIPS 2012 12 · Kamalika Chaudhuri, Anand Sarwate, Kaushik Sinha

Principal components analysis (PCA) is a standard tool for identifying good low-dimensional approximations to data sets in high dimension. Many current data sets of interest contain private or sensitive information abou…

Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices

2024-01-08 · T. Tony Cai, Dong Xia, Mengyue Zha

Estimating a covariance matrix and its associated principal components is a fundamental problem in contemporary statistics. While optimal estimation procedures have been developed with well-understood properties, the inc…

valid