paper-with-me

Papers

Multi-Source Collaborative Gradient Discrepancy Minimization for Federated Domain Generalization

2024-01-05 · Yikang Wei, Yahong Han

Federated Domain Generalization aims to learn a domain-invariant model from multiple decentralized source domains for deployment on unseen target domain. Due to privacy concerns, the data from different source domains are kept isolated, which poses challenges in bridging the domain gap. To address this issue, we propose a Multi-source Collaborative Gradient Discrepancy Minimization (MCGDM) method for federated domain generalization. Specifically, we propose intra-domain gradient matching between the original images and augmented images to avoid overfitting the domain-specific information within isolated domains. Additionally, we propose inter-domain gradient matching with the collaboration of other domains, which can further reduce the domain shift across decentralized domains. Combining intra-domain and inter-domain gradient matching, our method enables the learned model to generalize well on unseen domains. Furthermore, our method can be extended to the federated domain adaptation task by fine-tuning the target model on the pseudo-labeled target domain. The extensive experiments on federated domain generalization and adaptation indicate that our method outperforms the state-of-the-art methods significantly.

📄 PDF Abstract BibTeX arXiv:2401.10272

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationDomain Generalization

Similar Papers 제목 키워드 기반

Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation

2021-06-08 · CVPR 2021 1 · Zhekai Du, Jingjing Li, Hongzu Su, Lei Zhu 외

Unsupervised Domain Adaptation (UDA) aims to generalize the knowledge learned from a well-labeled source domain to an unlabeled target domain. Recently, adversarial domain adaptation with two distinct classifiers (bi-cla…

ClusteringDomain AdaptationSelf-Supervised LearningUnsupervised Domain Adaptation

Beyond Local Sharpness: Communication-Efficient Global Sharpness-aware Minimization for Federated Learning

2024-12-04 · CVPR 2025 1 · Debora Caldarola, Pietro Cagnasso, Barbara Caputo, Marco Ciccone

Federated learning (FL) enables collaborative model training with privacy preservation. Data heterogeneity across edge devices (clients) can cause models to converge to sharp minima, negatively impacting generalization a…

Federated Learning

Deep Hashing via Discrepancy Minimization

2018-06-01 · CVPR 2018 6 · Zhixiang Chen, Xin Yuan, Jiwen Lu, Qi Tian 외

This paper presents a discrepancy minimizing model to address the discrete optimization problem in hashing learning. The discrete optimization introduced by binary constraint is an NP-hard mixed integer programming prob…

Deep Hashing

Discrepancy Minimization in Domain Generalization with Generative Nearest Neighbors

2020-07-28 · Prashant Pandey, Mrigank Raman, Sumanth Varambally, Prathosh AP

Domain generalization (DG) deals with the problem of domain shift where a machine learning model trained on multiple-source domains fail to generalize well on a target domain with different statistics. Multiple approache…

Domain Generalization

Private Domain Adaptation from a Public Source

2022-08-12 · Raef Bassily, Mehryar Mohri, Ananda Theertha Suresh

A key problem in a variety of applications is that of domain adaptation from a public source domain, for which a relatively large amount of labeled data with no privacy constraints is at one's disposal, to a private targ…

Domain Adaptation