An Equivalence Between Data Poisoning and Byzantine Gradient Attacks
To study the resilience of distributed learning, the "Byzantine" literature considers a strong threat model where workers can report arbitrary gradients to the parameter server. Whereas this model helped obtain several fundamental results, it has sometimes been considered unrealistic, when the workers are mostly trustworthy machines. In this paper, we show a surprising equivalence between this model and data poisoning, a threat considered much more realistic. More specifically, we prove that every gradient attack can be reduced to data poisoning, in any personalized federated learning system with PAC guarantees (which we show are both desirable and realistic). This equivalence makes it possible to obtain new impossibility results on the resilience of any "robust" learning algorithm to data poisoning in highly heterogeneous applications, as corollaries of existing impossibility theorems on Byzantine machine learning. Moreover, using our equivalence, we derive a practical attack that we show (theoretically and empirically) can be very effective against classical personalized federated learning models.
Code (1)
Tasks
Data PoisoningFederated LearningPersonalized Federated LearningSimilar Papers 제목 키워드 기반
Robust Federated Recommendation System
Federated recommendation systems can provide good performance without collecting users' private data, making them attractive. However, they are susceptible to low-cost poisoning attacks that can degrade their performance…
Recommendation SystemsAGRAMPLIFIER: Defending Federated Learning Against Poisoning Attacks Through Local Update Amplification
The collaborative nature of federated learning (FL) poses a major threat in the form of manipulation of local training data and local updates, known as the Byzantine poisoning attack. To address this issue, many Byzantin…
Federated LearningByzantine-robust Federated Learning through Collaborative Malicious Gradient Filtering
Gradient-based training in federated learning is known to be vulnerable to faulty/malicious clients, which are often modeled as Byzantine clients. To this end, previous work either makes use of auxiliary data at paramete…
Federated LearningModel Poisoningtext-classificationText ClassificationPROFL: A Privacy-Preserving Federated Learning Method with Stringent Defense Against Poisoning Attacks
Federated Learning (FL) faces two major issues: privacy leakage and poisoning attacks, which may seriously undermine the reliability and security of the system. Overcoming them simultaneously poses a great challenge. Thi…
Federated LearningPrivacy PreservingAFLGuard: Byzantine-robust Asynchronous Federated Learning
Federated learning (FL) is an emerging machine learning paradigm, in which clients jointly learn a model with the help of a cloud server. A fundamental challenge of FL is that the clients are often heterogeneous, e.g., t…
Federated Learning