FedPrune: Towards Inclusive Federated Learning
Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy-preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in terms of computational and memory resources (system heterogeneity) and (ii) non-IID data distribution across clients (statistical heterogeneity). For example, slow clients get dropped in FL schemes, such as Federated Averaging (FedAvg), which not only limits overall learning but also biases results towards fast clients. We propose FedPrune; a system that tackles this challenge by pruning the global model for slow clients based on their device characteristics. By doing so, slow clients can train a small model quickly and participate in FL which increases test accuracy as well as fairness. By using insights from Central Limit Theorem, FedPrune incorporates a new aggregation technique that achieves robust performance over non-IID data. Experimental evaluation shows that Fed- Prune provides robust convergence and better fairness compared to Federated Averaging.
Code (0)
등록된 구현이 없습니다.
Tasks
FairnessFederated LearningPrivacy PreservingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
No One Left Behind: Inclusive Federated Learning over Heterogeneous Devices
Federated learning (FL) is an important paradigm for training global models from decentralized data in a privacy-preserving way. Existing FL methods usually assume the global model can be trained on any participating cli…
Federated LearningKnowledge DistillationPrivacy PreservingInclusive, Differentially Private Federated Learning for Clinical Data
Federated Learning (FL) offers a promising approach for training clinical AI models without centralizing sensitive patient data. However, its real-world adoption is hindered by challenges related to privacy, resource con…
Federated LearningFairness in Federated Learning for Spatial-Temporal Applications
Federated learning involves training statistical models over remote devices such as mobile phones while keeping data localized. Training in heterogeneous and potentially massive networks introduces opportunities for priv…
FairnessFederated LearningPrivacy PreservingInclusive Data Representation in Federated Learning: A Novel Approach Integrating Textual and Visual Prompt
Federated Learning (FL) is often impeded by communication overhead issues. Prompt tuning, as a potential solution, has been introduced to only adjust a few trainable parameters rather than the whole model. However, curre…
Contrastive LearningFederated LearningMultiConfederated Learning: Inclusive Non-IID Data handling with Decentralized Federated Learning
Federated Learning (FL) has emerged as a prominent privacy-preserving technique for enabling use cases like confidential clinical machine learning. FL operates by aggregating models trained by remote devices which owns t…
Federated LearningPrivacy PreservingTransfer Learning