Domain Generalization In Robust Invariant Representation
Unsupervised approaches for learning representations invariant to common transformations are used quite often for object recognition. Learning invariances makes models more robust and practical to use in real-world scenarios. Since data transformations that do not change the intrinsic properties of the object cause the majority of the complexity in recognition tasks, models that are invariant to these transformations help reduce the amount of training data required. This further increases the model's efficiency and simplifies training. In this paper, we investigate the generalization of invariant representations on out-of-distribution data and try to answer the question: Do model representations invariant to some transformations in a particular seen domain also remain invariant in previously unseen domains? Through extensive experiments, we demonstrate that the invariant model learns unstructured latent representations that are robust to distribution shifts, thus making invariance a desirable property for training in resource-constrained settings.
Code (1)
Tasks
Domain GeneralizationObject RecognitionSimilar Papers 제목 키워드 기반
Deep Domain Generalization via Conditional Invariant Adversarial Networks
Domain generalization aims to learn a classification model from multiple source domains and generalize it to unseen target domains. A critical problem in domain generalization involves learning domain-invariant represent…
Domain GeneralizationRepresentation LearningContinual Learning of Domain-Invariant Representations
Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to …
Representation LearningDomain GeneralizationContinual LearningVariational Invariant Learning for Bayesian Domain Generalization
Domain generalization addresses the out-of-distribution problem, which is challenging due to the domain shift and the uncertainty caused by the inaccessibility to data from the target domains. In this paper, we propose v…
Domain GeneralizationLearning to Learn Domain-invariant Parameters for Domain Generalization
Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from…
Domain GeneralizationEnhancing Evolving Domain Generalization through Dynamic Latent Representations
Domain generalization is a critical challenge for machine learning systems. Prior domain generalization methods focus on extracting domain-invariant features across several stationary domains to enable generalization to …
Domain GeneralizationEvolving Domain Generalization