paper-with-me

홈 › Papers

Robust and Differentially Private Mean Estimation

2021-02-18 · NeurIPS 2021 12 · Xiyang Liu, Weihao Kong, Sham Kakade, Sewoong Oh

In statistical learning and analysis from shared data, which is increasingly widely adopted in platforms such as federated learning and meta-learning, there are two major concerns: privacy and robustness. Each participating individual should be able to contribute without the fear of leaking one's sensitive information. At the same time, the system should be robust in the presence of malicious participants inserting corrupted data. Recent algorithmic advances in learning from shared data focus on either one of these threats, leaving the system vulnerable to the other. We bridge this gap for the canonical problem of estimating the mean from i.i.d. samples. We introduce PRIME, which is the first efficient algorithm that achieves both privacy and robustness for a wide range of distributions. We further complement this result with a novel exponential time algorithm that improves the sample complexity of PRIME, achieving a near-optimal guarantee and matching a known lower bound for (non-robust) private mean estimation. This proves that there is no extra statistical cost to simultaneously guaranteeing privacy and robustness.

📄 PDF Abstract BibTeX arXiv:2102.09159

Code (1)

xiyangl3/robust_dp 공식 구현

Tasks

Federated LearningMeta-Learning

Similar Papers 제목 키워드 기반

Propose, Test, Release: Differentially private estimation with high probability

2020-02-19 · Victor-Emmanuel Brunel, Marco Avella-Medina

We derive concentration inequalities for differentially private median and mean estimators building on the "Propose, Test, Release" (PTR) mechanism introduced by Dwork and Lei (2009). We introduce a new general version o…

Vocal Bursts Intensity Prediction

Designing Differentially Private Estimators in High Dimensions

2020-06-02 · Aditya Dhar, Jason Huang

We study differentially private mean estimation in a high-dimensional setting. Existing differential privacy techniques applied to large dimensions lead to computationally intractable problems or estimators with excessiv…

SensitivityVocal Bursts Intensity Prediction

Computationally tractable robust differentially private mean estimation

2026-06-10 · Kelly Ramsay arxiv

We develop a new, differentially private mean estimator called the balloon mean. The main features of the balloon mean are that it is computationally tractable and enjoys robustness to outlying observations. It is based …

PLAN: Variance-Aware Private Mean Estimation

2023-06-14 · Martin Aumüller, Christian Janos Lebeda, Boel Nelson, Rasmus Pagh

Differentially private mean estimation is an important building block in privacy-preserving algorithms for data analysis and machine learning. Though the trade-off between privacy and utility is well understood in the wo…

Privacy Preserving

Differentially Private Vertical Federated Clustering

2022-08-02 · Zitao Li, Tianhao Wang, Ninghui Li

In many applications, multiple parties have private data regarding the same set of users but on disjoint sets of attributes, and a server wants to leverage the data to train a model. To enable model learning while protec…

ClusteringFederated LearningVertical Federated Learning