paper-with-me

Papers

Optimal Algorithms for Mean Estimation under Local Differential Privacy

2022-05-05 · Hilal Asi, Vitaly Feldman, Kunal Talwar

We study the problem of mean estimation of $\ell_2$-bounded vectors under the constraint of local differential privacy. While the literature has a variety of algorithms that achieve the asymptotically optimal rates for this problem, the performance of these algorithms in practice can vary significantly due to varying (and often large) hidden constants. In this work, we investigate the question of designing the protocol with the smallest variance. We show that PrivUnit (Bhowmick et al. 2018) with optimized parameters achieves the optimal variance among a large family of locally private randomizers. To prove this result, we establish some properties of local randomizers, and use symmetrization arguments that allow us to write the optimal randomizer as the optimizer of a certain linear program. These structural results, which should extend to other problems, then allow us to show that the optimal randomizer belongs to the PrivUnit family. We also develop a new variant of PrivUnit based on the Gaussian distribution which is more amenable to mathematical analysis and enjoys the same optimality guarantees. This allows us to establish several useful properties on the exact constants of the optimal error as well as to numerically estimate these constants.

📄 PDF Abstract BibTeX arXiv:2205.02466

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithms

2020-01-24 · T. Tony Cai, Hongji Wei

We study distributed estimation of a Gaussian mean under communication constraints in a decision theoretical framework. Minimax rates of convergence, which characterize the tradeoff between the communication costs and st…

Fast Optimal Locally Private Mean Estimation via Random Projections

2023-06-07 · NeurIPS 2023 11 · Hilal Asi, Vitaly Feldman, Jelani Nelson, Huy L. Nguyen 외

We study the problem of locally private mean estimation of high-dimensional vectors in the Euclidean ball. Existing algorithms for this problem either incur sub-optimal error or have high communication and/or run-time co…

Federated Learning

Exact Optimality of Communication-Privacy-Utility Tradeoffs in Distributed Mean Estimation

2023-09-21 · NeurIPS 2023 11

We study the mean estimation problem under communication and local differential privacy constraints. While previous work has proposed order-optimal algorithms for the same problem (i.e., asymptotically optimal as we spen…

Outlier Robust Mean Estimation with Subgaussian Rates via Stability

2020-07-30 · NeurIPS 2020 12 · Ilias Diakonikolas, Daniel M. Kane, Ankit Pensia

We study the problem of outlier robust high-dimensional mean estimation under a finite covariance assumption, and more broadly under finite low-degree moment assumptions. We consider a standard stability condition from t…

Instance-Optimal Differentially Private Estimation

2022-10-28 · Audra McMillan, Adam Smith, Jon Ullman

In this work, we study local minimax convergence estimation rates subject to $\epsilon$-differential privacy. Unlike worst-case rates, which may be conservative, algorithms that are locally minimax optimal must adapt to …