Collaborative Optimization and Aggregation for Decentralized Domain Generalization and Adaptation
Contemporary domain generalization (DG) and multi-source unsupervised domain adaptation (UDA) methods mostly collect data from multiple domains together for joint optimization. However, this centralized training paradigm poses a threat to data privacy and is not applicable when data are non-shared across domains. In this work, we propose a new approach called Collaborative Optimization and Aggregation (COPA), which aims at optimizing a generalized target model for decentralized DG and UDA, where data from different domains are non-shared and private. Our base model consists of a domain-invariant feature extractor and an ensemble of domain-specific classifiers. In an iterative learning process, we optimize a local model for each domain, and then centrally aggregate local feature extractors and assemble domain-specific classifiers to construct a generalized global model, without sharing data from different domains. To improve generalization of feature extractors, we employ hybrid batch-instance normalization and collaboration of frozen classifiers. For better decentralized UDA, we further introduce a prediction agreement mechanism to overcome local disparities towards central model aggregation. Extensive experiments on five DG and UDA benchmark datasets show that COPA is capable of achieving comparable performance against the state-of-the-art DG and UDA methods without the need for centralized data collection in model training.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationDomain GeneralizationMulti-Source Unsupervised Domain AdaptationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
ColNet: Collaborative Optimization in Decentralized Federated Multi-task Learning Systems
The integration of Federated Learning (FL) and Multi-Task Learning (MTL) has been explored to address client heterogeneity, with Federated Multi-Task Learning (FMTL) treating each client as a distinct task. However, most…
Federated LearningMulti-Task LearningHFedATM: Hierarchical Federated Domain Generalization via Optimal Transport and Regularized Mean Aggregation
Federated Learning (FL) is a decentralized approach where multiple clients collaboratively train a shared global model without sharing their raw data. Despite its effectiveness, conventional FL faces scalability challeng…
Domain GeneralizationFederated LearningImpact of Network Topology on Byzantine Resilience in Decentralized Federated Learning
Federated learning (FL) enables a collaborative environment for training machine learning models without sharing training data between users. This is typically achieved by aggregating model gradients on a central server.…
Federated LearningMulti-Source Collaborative Gradient Discrepancy Minimization for Federated Domain Generalization
Federated Domain Generalization aims to learn a domain-invariant model from multiple decentralized source domains for deployment on unseen target domain. Due to privacy concerns, the data from different source domains ar…
Domain AdaptationDomain GeneralizationCollaborative Semantic Aggregation and Calibration for Federated Domain Generalization
Domain generalization (DG) aims to learn from multiple known source domains a model that can generalize well to unknown target domains. The existing DG methods usually exploit the fusion of shared multi-source data to tr…
Domain Generalization