EBS-CFL: Efficient and Byzantine-robust Secure Clustered Federated Learning
Despite federated learning (FL)'s potential in collaborative learning, its performance has deteriorated due to the data heterogeneity of distributed users. Recently, clustered federated learning (CFL) has emerged to address this challenge by partitioning users into clusters according to their similarity. However, CFL faces difficulties in training when users are unwilling to share their cluster identities due to privacy concerns. To address these issues, we present an innovative Efficient and Robust Secure Aggregation scheme for CFL, dubbed EBS-CFL. The proposed EBS-CFL supports effectively training CFL while maintaining users' cluster identity confidentially. Moreover, it detects potential poisonous attacks without compromising individual client gradients by discarding negatively correlated gradients and aggregating positively correlated ones using a weighted approach. The server also authenticates correct gradient encoding by clients. EBS-CFL has high efficiency with client-side overhead O(ml + m^2) for communication and O(m^2l) for computation, where m is the number of cluster identities, and l is the gradient size. When m = 1, EBS-CFL's computational efficiency of client is at least O(log n) times better than comparison schemes, where n is the number of clients.In addition, we validate the scheme through extensive experiments. Finally, we theoretically prove the scheme's security.
Code (1)
Tasks
Computational EfficiencyFederated LearningSimilar Papers 제목 키워드 기반
Secure Byzantine-Robust Distributed Learning via Clustering
Federated learning systems that jointly preserve Byzantine robustness and privacy have remained an open problem. Robust aggregation, the standard defense for Byzantine attacks, generally requires server access to individ…
ClusteringFederated LearningPrivacy PreservingCQSA: Byzantine-robust Clustered Quantum Secure Aggregation in Federated Learning
Federated Learning (FL) enables collaborative model training without sharing raw data. However, shared local model updates remain vulnerable to inference and poisoning attacks. Secure aggregation schemes have been propos…
Federated LearningByzantine-Resilient Secure Federated Learning
Secure federated learning is a privacy-preserving framework to improve machine learning models by training over large volumes of data collected by mobile users. This is achieved through an iterative process where, at eac…
Federated LearningOutlier DetectionPrivacy PreservingQuantizationSecure Byzantine-Robust Federated Learning with Dimension-free Error
In the present work, we propose a federated learning protocol with bi-directional security guarantees. First, our protocol is Byzantine-robust against malicious clients. Additionally, it is the first federated learning p…
Federated LearningByzantine-Robust Clustered Federated Learning
This paper focuses on the problem of adversarial attacks from Byzantine machines in a Federated Learning setting where non-Byzantine machines can be partitioned into disjoint clusters. In this setting, non-Byzantine mach…
ClusteringFederated Learning