Personalized Cross-Silo Federated Learning on Non-IID Data
Non-IID data present a tough challenge for federated learning. In this paper, we explore a novel idea of facilitating pairwise collaborations between clients with similar data. We propose FedAMP, a new method employing federated attentive message passing to facilitate similar clients to collaborate more. We establish the convergence of FedAMP for both convex and non-convex models, and propose a heuristic method to further improve the performance of FedAMP when clients adopt deep neural networks as personalized models. Our extensive experiments on benchmark data sets demonstrate the superior performance of the proposed methods.
Code (1)
Tasks
Federated LearningSimilar Papers 제목 키워드 기반
Privacy Preserving Machine Learning Model Personalization through Federated Personalized Learning
The widespread adoption of Artificial Intelligence (AI) has been driven by significant advances in intelligent system research. However, this progress has raised concerns about data privacy, leading to a growing awarenes…
Federated LearningPrivacy PreservingpFLFE: Cross-silo Personalized Federated Learning via Feature Enhancement on Medical Image Segmentation
In medical image segmentation, personalized cross-silo federated learning (FL) is becoming popular for utilizing varied data across healthcare settings to overcome data scarcity and privacy concerns. However, existing me…
Federated LearningImage SegmentationMedical Image SegmentationPersonalized Federated Learning+2Cross-silo Federated Learning with Record-level Personalized Differential Privacy
Federated learning (FL) enhanced by differential privacy has emerged as a popular approach to better safeguard the privacy of client-side data by protecting clients' contributions during the training process. Existing so…
Federated LearningAdapt to Adaptation: Learning Personalization for Cross-Silo Federated Learning
Conventional federated learning (FL) trains one global model for a federation of clients with decentralized data, reducing the privacy risk of centralized training. However, the distribution shift across non-IID datasets…
Federated LearningAdapt to Adaptation: Learning to Personalize for Cross-Silo Federated Learning
The goal of conventional federated learning (FL) is to train a global model for a federation of clients with decentralized data, reducing the systemic privacy risk of centralized training. The distribution shift across n…
Federated Learning