PRECAD: Privacy-Preserving and Robust Federated Learning via Crypto-Aided Differential Privacy
Federated Learning (FL) allows multiple participating clients to train machine learning models collaboratively by keeping their datasets local and only exchanging model updates. Existing FL protocol designs have been shown to be vulnerable to attacks that aim to compromise data privacy and/or model robustness. Recently proposed defenses focused on ensuring either privacy or robustness, but not both. In this paper, we develop a framework called PRECAD, which simultaneously achieves differential privacy (DP) and enhances robustness against model poisoning attacks with the help of cryptography. Using secure multi-party computation (MPC) techniques (e.g., secret sharing), noise is added to the model updates by the honest-but-curious server(s) (instead of each client) without revealing clients' inputs, which achieves the benefit of centralized DP in terms of providing a better privacy-utility tradeoff than local DP based solutions. Meanwhile, a crypto-aided secure validation protocol is designed to verify that the contribution of model update from each client is bounded without leaking privacy. We show analytically that the noise added to ensure DP also provides enhanced robustness against malicious model submissions. We experimentally demonstrate that our PRECAD framework achieves higher privacy-utility tradeoff and enhances robustness for the trained models.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningModel PoisoningPrivacy PreservingSimilar Papers 제목 키워드 기반
Privacy-Preserving Federated Learning with Verifiable Fairness Guarantees
Federated learning enables collaborative model training across distributed institutions without centralizing sensitive data; however, ensuring algorithmic fairness across heterogeneous data distributions while preserving…
Federated LearningPOSEIDON: Privacy-Preserving Federated Neural Network Learning
In this paper, we address the problem of privacy-preserving training and evaluation of neural networks in an $N$-party, federated learning setting. We propose a novel system, POSEIDON, the first of its kind in the regime…
Federated LearningPrivacy PreservingFederated Learning is Better with Non-Homomorphic Encryption
Traditional AI methodologies necessitate centralized data collection, which becomes impractical when facing problems with network communication, data privacy, or storage capacity. Federated Learning (FL) offers a paradig…
Federated LearningPrivacy PreservingHybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning
Federated learning has emerged as a promising approach for collaborative and privacy-preserving learning. Participants in a federated learning process cooperatively train a model by exchanging model parameters instead of…
Federated LearningPrivacy PreservingTowards Secure and Practical Machine Learning via Secret Sharing and Random Permutation
With the increasing demands for privacy protection, privacy-preserving machine learning has been drawing much attention in both academia and industry. However, most existing methods have their limitations in practical ap…
BIG-bench Machine LearningPrivacy PreservingPrivacy Preserving Deep Learning