Domain Invariant Representation Learning with Domain Density Transformations
Domain generalization refers to the problem where we aim to train a model on data from a set of source domains so that the model can generalize to unseen target domains. Naively training a model on the aggregate set of data (pooled from all source domains) has been shown to perform suboptimally, since the information learned by that model might be domain-specific and generalize imperfectly to target domains. To tackle this problem, a predominant approach is to find and learn some domain-invariant information in order to use it for the prediction task. In this paper, we propose a theoretically grounded method to learn a domain-invariant representation by enforcing the representation network to be invariant under all transformation functions among domains. We also show how to use generative adversarial networks to learn such domain transformations to implement our method in practice. We demonstrate the effectiveness of our method on several widely used datasets for the domain generalization problem, on all of which we achieve competitive results with state-of-the-art models.
Code (1)
Tasks
Domain GeneralizationRepresentation LearningSimilar Papers 제목 키워드 기반
Domain Generalization In Robust Invariant Representation
Unsupervised approaches for learning representations invariant to common transformations are used quite often for object recognition. Learning invariances makes models more robust and practical to use in real-world scena…
Domain GeneralizationObject RecognitionOut-of-distribution Generalization with Causal Invariant Transformations
In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, wi…
Out-of-Distribution GeneralizationImproving OOD Generalization with Causal Invariant Transformations
In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, wi…
Domain Adaptation with Invariant Representation Learning: What Transformations to Learn?
Unsupervised domain adaptation, as a prevalent transfer learning setting, spans many real-world applications. With the increasing representational power and applicability of neural networks, state-of-the-art domain adapt…
Domain AdaptationRepresentation LearningTransfer LearningUnsupervised Domain AdaptationSupport and Invertibility in Domain-Invariant Representations
Learning domain-invariant representations has become a popular approach to unsupervised domain adaptation and is often justified by invoking a particular suite of theoretical results. We argue that there are two signific…
Domain AdaptationGeneralization BoundsUnsupervised Domain Adaptation