paper-with-me

홈 › Papers

Cross Domain Ensemble Distillation for Domain Generalization

2021-09-29 · kyungmoon lee, Sungyeon Kim, Suha Kwak

For domain generalization, the task of learning a model that generalizes to unseen target domains utilizing multiple source domains, many approaches explicitly align the distribution of the domains. However, the optimization for domain alignment has a risk of overfitting since the target domain is not available. To address the issue, this paper proposes a method for domain generalization by employing self-distillation. The proposed method aims to train a model robust to domain shift by allowing meaningful erroneous predictions in multiple domains. Specifically, our method matches the ensemble of predictive distributions of data with the same class label but different domains with each predictive distribution. We also propose a de-stylization method that standardizes feature maps of images to help produce consistent predictions. Image classification experiments on two benchmarks demonstrated that the proposed method greatly improves performance in both single-source and multi-source settings. We also show that the proposed method works effectively in person-reID experiments. In all experiments, our method significantly improves the performance.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Generalizationimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Cross-Domain Ensemble Distillation for Domain Generalization

2022-11-25 · European Conference on Computer Vision (ECCV) 2022 10 · kyungmoon lee, Sungyeon Kim, Suha Kwak

Domain generalization is the task of learning models that generalize to unseen target domains. We propose a simple yet effective method for domain generalization, named cross-domain ensemble distillation (XDED), that lea…

Domain Generalizationimage-classificationImage ClassificationImage to sketch recognition+2

Long-Term Vehicle Localization by Recursive Knowledge Distillation

2019-04-07 · Hiroki Tomoe, Tanaka Kanji

Most of the current state-of-the-art frameworks for cross-season visual place recognition (CS-VPR) focus on domain adaptation (DA) to a single specific season. From the viewpoint of long-term CS-VPR, such frameworks do n…

Domain AdaptationEnsemble LearningKnowledge DistillationMemorization+1

Multi-Source Collaborative Style Augmentation and Domain-Invariant Learning for Federated Domain Generalization

2025-05-15 · Yikang Wei

Federated domain generalization aims to learn a generalizable model from multiple decentralized source domains for deploying on the unseen target domain. The style augmentation methods have achieved great progress on dom…

Domain Generalization

Motor Imagery Decoding Using Ensemble Curriculum Learning and Collaborative Training

2022-11-21 · Georgios Zoumpourlis, Ioannis Patras

In this work, we study the problem of cross-subject motor imagery (MI) decoding from electroencephalography (EEG) data. Multi-subject EEG datasets present several kinds of domain shifts due to various inter-individual di…

AnatomyDomain GeneralizationEEGElectroencephalogram (EEG)+2

Domain Generalization for Crop Segmentation with Standardized Ensemble Knowledge Distillation

2023-04-03 · Simone Angarano, Mauro Martini, Alessandro Navone, Marcello Chiaberge

In recent years, precision agriculture has gradually oriented farming closer to automation processes to support all the activities related to field management. Service robotics plays a predominant role in this evolution …

Domain GeneralizationKnowledge DistillationManagementNavigate+1