paper-with-me

Papers

Private Covariance Approximation and Eigenvalue-Gap Bounds for Complex Gaussian Perturbations

2023-06-29 · Oren Mangoubi, Nisheeth K. Vishnoi

We consider the problem of approximating a $d \times d$ covariance matrix $M$ with a rank-$k$ matrix under $(\varepsilon,\delta)$-differential privacy. We present and analyze a complex variant of the Gaussian mechanism and show that the Frobenius norm of the difference between the matrix output by this mechanism and the best rank-$k$ approximation to $M$ is bounded by roughly $\tilde{O}(\sqrt{kd})$, whenever there is an appropriately large gap between the $k$'th and the $k+1$'th eigenvalues of $M$. This improves on previous work that requires that the gap between every pair of top-$k$ eigenvalues of $M$ is at least $\sqrt{d}$ for a similar bound. Our analysis leverages the fact that the eigenvalues of complex matrix Brownian motion repel more than in the real case, and uses Dyson's stochastic differential equations governing the evolution of its eigenvalues to show that the eigenvalues of the matrix $M$ perturbed by complex Gaussian noise have large gaps with high probability. Our results contribute to the analysis of low-rank approximations under average-case perturbations and to an understanding of eigenvalue gaps for random matrices, which may be of independent interest.

📄 PDF Abstract BibTeX arXiv:2306.16648

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Private Low-Rank Approximation for Covariance Matrices, Dyson Brownian Motion, and Eigenvalue-Gap Bounds for Gaussian Perturbations

2025-02-11 · Oren Mangoubi, Nisheeth K. Vishnoi

We consider the problem of approximating a $d \times d$ covariance matrix $M$ with a rank-$k$ matrix under $(\varepsilon,\delta)$-differential privacy. We present and analyze a complex variant of the Gaussian mechanism a…

Re-Analyze Gauss: Bounds for Private Matrix Approximation via Dyson Brownian Motion

2022-11-11 · Oren Mangoubi, Nisheeth K. Vishnoi

Given a symmetric matrix $M$ and a vector $\lambda$, we present new bounds on the Frobenius-distance utility of the Gaussian mechanism for approximating $M$ by a matrix whose spectrum is $\lambda$, under $(\varepsilon,\d…

Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices

2024-01-08 · T. Tony Cai, Dong Xia, Mengyue Zha

Estimating a covariance matrix and its associated principal components is a fundamental problem in contemporary statistics. While optimal estimation procedures have been developed with well-understood properties, the inc…

valid

New Lower Bounds for Private Estimation and a Generalized Fingerprinting Lemma

2022-05-17 · Gautam Kamath, Argyris Mouzakis, Vikrant Singhal

We prove new lower bounds for statistical estimation tasks under the constraint of $(\varepsilon, \delta)$-differential privacy. First, we provide tight lower bounds for private covariance estimation of Gaussian distribu…

LEMMA

Simple Relative Deviation Bounds for Covariance and Gram Matrices

2024-10-08 · Daniel Barzilai, Ohad Shamir

We provide non-asymptotic, relative deviation bounds for the eigenvalues of empirical covariance and Gram matrices in general settings. Unlike typical uniform bounds, which may fail to capture the behavior of smaller eig…