paper-with-me

홈 › Papers

Breaking the Communication-Privacy-Accuracy Tradeoff with $f$-Differential Privacy

2023-02-19 · NeurIPS 2023 11 · Richeng Jin, Zhonggen Su, Caijun Zhong, Zhaoyang Zhang, Tony Quek, Huaiyu Dai

We consider a federated data analytics problem in which a server coordinates the collaborative data analysis of multiple users with privacy concerns and limited communication capability. The commonly adopted compression schemes introduce information loss into local data while improving communication efficiency, and it remains an open problem whether such discrete-valued mechanisms provide any privacy protection. In this paper, we study the local differential privacy guarantees of discrete-valued mechanisms with finite output space through the lens of $f$-differential privacy (DP). More specifically, we advance the existing literature by deriving tight $f$-DP guarantees for a variety of discrete-valued mechanisms, including the binomial noise and the binomial mechanisms that are proposed for privacy preservation, and the sign-based methods that are proposed for data compression, in closed-form expressions. We further investigate the amplification in privacy by sparsification and propose a ternary stochastic compressor. By leveraging compression for privacy amplification, we improve the existing methods by removing the dependency of accuracy (in terms of mean square error) on communication cost in the popular use case of distributed mean estimation, therefore breaking the three-way tradeoff between privacy, communication, and accuracy. Finally, we discuss the Byzantine resilience of the proposed mechanism and its application in federated learning.

📄 PDF Abstract BibTeX arXiv:2302.09624

Code (0)

등록된 구현이 없습니다.

Tasks

Data CompressionFederated Learning

Similar Papers 제목 키워드 기반

Optimal Compression of Locally Differentially Private Mechanisms

2021-10-29 · Abhin Shah, Wei-Ning Chen, Johannes Balle, Peter Kairouz 외

Compressing the output of \epsilon-locally differentially private (LDP) randomizers naively leads to suboptimal utility. In this work, we demonstrate the benefits of using schemes that jointly compress and privatize the …

Locally Differentially Private Gradient Tracking for Distributed Online Learning over Directed Graphs

2023-10-24 · Ziqin Chen, Yongqiang Wang

Distributed online learning has been proven extremely effective in solving large-scale machine learning problems over streaming data. However, information sharing between learners in distributed learning also raises conc…

image-classificationImage Classification

Differentially Private Wireless Federated Learning Using Orthogonal Sequences

2023-06-14 · Xizixiang Wei, Tianhao Wang, Ruiquan Huang, Cong Shen 외

We propose a privacy-preserving uplink over-the-air computation (AirComp) method, termed FLORAS, for single-input single-output (SISO) wireless federated learning (FL) systems. From the perspective of communication desig…

Federated LearningPrivacy Preserving

Differential Privacy in Cooperative Multiagent Planning

2023-01-20 · Bo Chen, Calvin Hawkins, Mustafa O. Karabag, Cyrus Neary 외

Privacy-aware multiagent systems must protect agents' sensitive data while simultaneously ensuring that agents accomplish their shared objectives. Towards this goal, we propose a framework to privatize inter-agent commun…

Decision MakingSequential Decision Making

CRS-FL: Conditional Random Sampling for Communication-Efficient and Privacy-Preserving Federated Learning

2023-06-01 · Jianhua Wang, Xiaolin Chang, Jelena Mišić, Vojislav B. Mišić 외

Federated Learning (FL), a privacy-oriented distributed ML paradigm, is being gaining great interest in Internet of Things because of its capability to protect participants data privacy. Studies have been conducted to ad…

Federated LearningPrivacy Preserving