Federated Learning with Domain Generalization
Federated Learning (FL) enables a group of clients to jointly train a machine learning model with the help of a centralized server. Clients do not need to submit their local data to the server during training, and hence the local training data of clients is protected. In FL, distributed clients collect their local data independently, so the dataset of each client may naturally form a distinct source domain. In practice, the model trained over multiple source domains may have poor generalization performance on unseen target domains. To address this issue, we propose FedADG to equip federated learning with domain generalization capability. FedADG employs the federated adversarial learning approach to measure and align the distributions among different source domains via matching each distribution to a reference distribution. The reference distribution is adaptively generated (by accommodating all source domains) to minimize the domain shift distance during alignment. In FedADG, the alignment is fine-grained since each class is aligned independently. In this way, the learned feature representation is supposed to be universal, so it can generalize well on the unseen domains. Intensive experiments on various datasets demonstrate that FedADG has comparable performance with the state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain GeneralizationFederated LearningSimilar Papers 제목 키워드 기반
Hypernetwork-Driven Model Fusion for Federated Domain Generalization
Federated Learning (FL) faces significant challenges with domain shifts in heterogeneous data, degrading performance. Traditional domain generalization aims to learn domain-invariant features, but the federated nature of…
Domain GeneralizationFederated LearningMulti-Source Collaborative Gradient Discrepancy Minimization for Federated Domain Generalization
Federated Domain Generalization aims to learn a domain-invariant model from multiple decentralized source domains for deployment on unseen target domain. Due to privacy concerns, the data from different source domains ar…
Domain AdaptationDomain GeneralizationFedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization
Traditional domain generalization approaches predominantly focus on leveraging target domain-aware features while overlooking the critical role of source domain-specific characteristics, particularly in federated setting…
Domain GeneralizationKnowledge DistillationMulti-Source Collaborative Style Augmentation and Domain-Invariant Learning for Federated Domain Generalization
Federated domain generalization aims to learn a generalizable model from multiple decentralized source domains for deploying on the unseen target domain. The style augmentation methods have achieved great progress on dom…
Domain GeneralizationFederated Domain Generalization with Domain-specific Soft Prompts Generation
Prompt learning has become an efficient paradigm for adapting CLIP to downstream tasks. Compared with traditional fine-tuning, prompt learning optimizes a few parameters yet yields highly competitive results, especially …
Computational EfficiencyDomain GeneralizationFederated Learning