Federated Unsupervised Domain Generalization using Global and Local Alignment of Gradients
We address the problem of federated domain generalization in an unsupervised setting for the first time. We first theoretically establish a connection between domain shift and alignment of gradients in unsupervised federated learning and show that aligning the gradients at both client and server levels can facilitate the generalization of the model to new (target) domains. Building on this insight, we propose a novel method named FedGaLA, which performs gradient alignment at the client level to encourage clients to learn domain-invariant features, as well as global gradient alignment at the server to obtain a more generalized aggregated model. To empirically evaluate our method, we perform various experiments on four commonly used multi-domain datasets, PACS, OfficeHome, DomainNet, and TerraInc. The results demonstrate the effectiveness of our method which outperforms comparable baselines. Ablation and sensitivity studies demonstrate the impact of different components and parameters in our approach. The source code is available at: https://github.com/MahdiyarMM/FedGaLA.
Code (1)
Tasks
Domain GeneralizationFederated LearningSimilar Papers 제목 키워드 기반
FedDAG: Federated Domain Adversarial Generation Towards Generalizable Medical Image Analysis
Federated domain generalization aims to train a global model from multiple source domains and ensure its generalization ability to unseen target domains. Due to the target domain being with unknown domain shifts, attempt…
AttributeDomain GeneralizationMedical Image AnalysisFedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalization
Federated Domain Generalization (FedDG) aims to train the global model for generalization ability to unseen domains with multi-domain training samples. However, clients in federated learning networks are often confined t…
Domain GeneralizationFederated LearningFederated Domain Generalization via Prompt Learning and Aggregation
Federated domain generalization (FedDG) aims to improve the global model generalization in unseen domains by addressing data heterogeneity under privacy-preserving constraints. A common strategy in existing FedDG studies…
Domain GeneralizationPrivacy PreservingPrompt LearningTransfer LearningFederated Domain Generalization with Latent Space Inversion
Federated domain generalization (FedDG) addresses distribution shifts among clients in a federated learning framework. FedDG methods aggregate the parameters of locally trained client models to form a global model that g…
Domain GeneralizationFederated LearningFedDEAP: Adaptive Dual-Prompt Tuning for Multi-Domain Federated Learning
Federated learning (FL) enables multiple clients to collaboratively train machine learning models without exposing local data, balancing performance and privacy. However, domain shift and label heterogeneity across clien…
Federated Learning