paper-with-me

Papers

Scalable and Differentially Private Distributed Aggregation in the Shuffled Model

2019-06-19 · Badih Ghazi, Rasmus Pagh, Ameya Velingker

Federated learning promises to make machine learning feasible on distributed, private datasets by implementing gradient descent using secure aggregation methods. The idea is to compute a global weight update without revealing the contributions of individual users. Current practical protocols for secure aggregation work in an "honest but curious" setting where a curious adversary observing all communication to and from the server cannot learn any private information assuming the server is honest and follows the protocol. A more scalable and robust primitive for privacy-preserving protocols is shuffling of user data, so as to hide the origin of each data item. Highly scalable and secure protocols for shuffling, so-called mixnets, have been proposed as a primitive for privacy-preserving analytics in the Encode-Shuffle-Analyze framework by Bittau et al., which was later analytically studied by Erlingsson et al. and Cheu et al.. The recent papers by Cheu et al., and Balle et al. have given protocols for secure aggregation that achieve differential privacy guarantees in this "shuffled model". Their protocols come at a cost, though: Either the expected aggregation error or the amount of communication per user scales as a polynomial $n^{\Omega(1)}$ in the number of users $n$. In this paper we propose simple and more efficient protocol for aggregation in the shuffled model, where communication as well as error increases only polylogarithmically in $n$. Our new technique is a conceptual "invisibility cloak" that makes users' data almost indistinguishable from random noise while introducing zero distortion on the sum.

📄 PDF Abstract BibTeX arXiv:1906.08320

Code (0)

등록된 구현이 없습니다.

Tasks

Federated LearningPrivacy Preserving

Similar Papers 제목 키워드 기반

Multi-Message Shuffled Privacy in Federated Learning

2023-02-22 · Antonious M. Girgis, Suhas Diggavi

We study differentially private distributed optimization under communication constraints. A server using SGD for optimization aggregates the client-side local gradients for model updates using distributed mean estimation…

Distributed OptimizationFederated LearningOpen-Ended Question Answering

Scalable and Provably Accurate Algorithms for Differentially Private Distributed Decision Tree Learning

2020-12-19 · Kaiwen Wang, Travis Dick, Maria-Florina Balcan

This paper introduces the first provably accurate algorithms for differentially private, top-down decision tree learning in the distributed setting (Balcan et al., 2012). We propose DP-TopDown, a general privacy preservi…

Privacy Preserving

Differentially Private Stochastic Linear Bandits: (Almost) for Free

2022-07-07 · Osama A. Hanna, Antonious M. Girgis, Christina Fragouli, Suhas Diggavi

In this paper, we propose differentially private algorithms for the problem of stochastic linear bandits in the central, local and shuffled models. In the central model, we achieve almost the same regret as the optimal n…

Scalable Differentially Private Data Generation via Private Aggregation of Teacher Ensembles

2019-09-25 · Yunhui Long, Suxin Lin, Zhuolin Yang, Carl A. Gunter 외

We present a novel approach named G-PATE for training differentially private data generator. The generator can be used to produce synthetic datasets with strong privacy guarantee while preserving high data utility. Our a…

G-PATE: Scalable Differentially Private Data Generator via Private Aggregation of Teacher Discriminators

2019-06-21 · NeurIPS 2021 12 · Yunhui Long, Boxin Wang, Zhuolin Yang, Bhavya Kailkhura 외

Recent advances in machine learning have largely benefited from the massive accessible training data. However, large-scale data sharing has raised great privacy concerns. In this work, we propose a novel privacy-preservi…

BIG-bench Machine LearningPrivacy Preserving