Domain Generalization: A Survey
Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is often violated in practice due to domain shift. Domain generalization (DG) aims to achieve OOD generalization by using only source data for model learning. Over the last ten years, research in DG has made great progress, leading to a broad spectrum of methodologies, e.g., those based on domain alignment, meta-learning, data augmentation, or ensemble learning, to name a few; DG has also been studied in various application areas including computer vision, speech recognition, natural language processing, medical imaging, and reinforcement learning. In this paper, for the first time a comprehensive literature review in DG is provided to summarize the developments over the past decade. Specifically, we first cover the background by formally defining DG and relating it to other relevant fields like domain adaptation and transfer learning. Then, we conduct a thorough review into existing methods and theories. Finally, we conclude this survey with insights and discussions on future research directions.
Code (2)
Tasks
Action RecognitionData AugmentationDomain AdaptationDomain GeneralizationEnsemble LearningMeta-LearningObject RecognitionPerson Re-Identificationspeech-recognitionSpeech RecognitionSurveyTransfer LearningSimilar Papers 제목 키워드 기반
Domain Generalization for Semantic Segmentation: A Survey
The generalization of deep neural networks to unknown domains is a major challenge despite their tremendous progress in recent years. For this reason, the dynamic area of domain generalization (DG) has emerged. In contra…
Unsupervised Domain AdaptationDomain GeneralizationSemantic SegmentationCLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey
As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for enhancing model robustness across diverse environments. Contrastive Language-Image Pretraining (CLIP) plays a sig…
Computational EfficiencyDomain AdaptationDomain GeneralizationPrompt Learning+2Domain Generalization -- A Causal Perspective
Machine learning models rely on various assumptions to attain high accuracy. One of the preliminary assumptions of these models is the independent and identical distribution, which suggests that the train and test data a…
Data AugmentationDomain GeneralizationRepresentation LearningGeneralization in Neural Networks: A Broad Survey
This paper reviews concepts, modeling approaches, and recent findings along a spectrum of different levels of abstraction of neural network models including generalization across (1) Samples, (2) Distributions, (3) Domai…
Domain AdaptationDomain GeneralizationKnowledge GraphsMeta-Learning+2Federated Domain Generalization: A Survey
Machine learning typically relies on the assumption that training and testing distributions are identical and that data is centrally stored for training and testing. However, in real-world scenarios, distributions may di…
Domain AdaptationDomain GeneralizationFederated LearningSurvey