Cross Domain Ensemble Distillation for Domain Generalization
For domain generalization, the task of learning a model that generalizes to unseen target domains utilizing multiple source domains, many approaches explicitly align the distribution of the domains. However, the optimization for domain alignment has a risk of overfitting since the target domain is not available. To address the issue, this paper proposes a method for domain generalization by employing self-distillation. The proposed method aims to train a model robust to domain shift by allowing meaningful erroneous predictions in multiple domains. Specifically, our method matches the ensemble of predictive distributions of data with the same class label but different domains with each predictive distribution. We also propose a de-stylization method that standardizes feature maps of images to help produce consistent predictions. Image classification experiments on two benchmarks demonstrated that the proposed method greatly improves performance in both single-source and multi-source settings. We also show that the proposed method works effectively in person-reID experiments. In all experiments, our method significantly improves the performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain Generalizationimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Cross-Domain Ensemble Distillation for Domain Generalization
Domain generalization is the task of learning models that generalize to unseen target domains. We propose a simple yet effective method for domain generalization, named cross-domain ensemble distillation (XDED), that lea…
Domain Generalizationimage-classificationImage ClassificationImage to sketch recognition+2Long-Term Vehicle Localization by Recursive Knowledge Distillation
Most of the current state-of-the-art frameworks for cross-season visual place recognition (CS-VPR) focus on domain adaptation (DA) to a single specific season. From the viewpoint of long-term CS-VPR, such frameworks do n…
Domain AdaptationEnsemble LearningKnowledge DistillationMemorization+1Multi-Source Collaborative Style Augmentation and Domain-Invariant Learning for Federated Domain Generalization
Federated domain generalization aims to learn a generalizable model from multiple decentralized source domains for deploying on the unseen target domain. The style augmentation methods have achieved great progress on dom…
Domain GeneralizationMotor Imagery Decoding Using Ensemble Curriculum Learning and Collaborative Training
In this work, we study the problem of cross-subject motor imagery (MI) decoding from electroencephalography (EEG) data. Multi-subject EEG datasets present several kinds of domain shifts due to various inter-individual di…
AnatomyDomain GeneralizationEEGElectroencephalogram (EEG)+2Domain Generalization for Crop Segmentation with Standardized Ensemble Knowledge Distillation
In recent years, precision agriculture has gradually oriented farming closer to automation processes to support all the activities related to field management. Service robotics plays a predominant role in this evolution …
Domain GeneralizationKnowledge DistillationManagementNavigate+1