paper-with-me

Papers

Fast Optimal Locally Private Mean Estimation via Random Projections

2023-06-07 · NeurIPS 2023 11 · Hilal Asi, Vitaly Feldman, Jelani Nelson, Huy L. Nguyen, Kunal Talwar

We study the problem of locally private mean estimation of high-dimensional vectors in the Euclidean ball. Existing algorithms for this problem either incur sub-optimal error or have high communication and/or run-time complexity. We propose a new algorithmic framework, ProjUnit, for private mean estimation that yields algorithms that are computationally efficient, have low communication complexity, and incur optimal error up to a $1+o(1)$-factor. Our framework is deceptively simple: each randomizer projects its input to a random low-dimensional subspace, normalizes the result, and then runs an optimal algorithm such as PrivUnitG in the lower-dimensional space. In addition, we show that, by appropriately correlating the random projection matrices across devices, we can achieve fast server run-time. We mathematically analyze the error of the algorithm in terms of properties of the random projections, and study two instantiations. Lastly, our experiments for private mean estimation and private federated learning demonstrate that our algorithms empirically obtain nearly the same utility as optimal ones while having significantly lower communication and computational cost.

📄 PDF Abstract BibTeX arXiv:2306.04444

Code (2)

apple/ml-projunit 공식 구현 pytorch
Shuangqing-Xu/Camel pytorch

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Instance-Optimal Differentially Private Estimation

2022-10-28 · Audra McMillan, Adam Smith, Jon Ullman

In this work, we study local minimax convergence estimation rates subject to $\epsilon$-differential privacy. Unlike worst-case rates, which may be conservative, algorithms that are locally minimax optimal must adapt to …

Optimal Compression of Locally Differentially Private Mechanisms

2021-10-29 · Abhin Shah, Wei-Ning Chen, Johannes Balle, Peter Kairouz 외

Compressing the output of \epsilon-locally differentially private (LDP) randomizers naively leads to suboptimal utility. In this work, we demonstrate the benefits of using schemes that jointly compress and privatize the …

Optimal locally private estimation under $\ell_p$ loss for $1\le p\le 2$

2018-10-16 · Min Ye, Alexander Barg

We consider the minimax estimation problem of a discrete distribution with support size $k$ under locally differential privacy constraints. A privatization scheme is applied to each raw sample independently, and we need …

valid

Communication Complexity in Locally Private Distribution Estimation and Heavy Hitters

2019-05-28 · Jayadev Acharya, Ziteng Sun

We consider the problems of distribution estimation and heavy hitter (frequency) estimation under privacy and communication constraints. While these constraints have been studied separately, optimal schemes for one are s…

Locally Private Gaussian Estimation

2018-11-20 · NeurIPS 2019 12 · Matthew Joseph, Janardhan Kulkarni, Jieming Mao, Zhiwei Steven Wu

We study a basic private estimation problem: each of $n$ users draws a single i.i.d. sample from an unknown Gaussian distribution, and the goal is to estimate the mean of this Gaussian distribution while satisfying local…