MetaReg: Towards Domain Generalization using Meta-Regularization
Training models that generalize to new domains at test time is a problem of fundamental importance in machine learning. In this work, we encode this notion of domain generalization using a novel regularization function. We pose the problem of finding such a regularization function in a Learning to Learn (or) meta-learning framework. The objective of domain generalization is explicitly modeled by learning a regularizer that makes the model trained on one domain to perform well on another domain. Experimental validations on computer vision and natural language datasets indicate that our method can learn regularizers that achieve good cross-domain generalization.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningDomain GeneralizationMeta-LearningSimilar Papers 제목 키워드 기반
MetaRegNet: Metamorphic Image Registration Using Flow-Driven Residual Networks
Deep learning based methods provide efficient solutions to medical image registration, including the challenging problem of diffeomorphic image registration. However, most methods register normal image pairs, facing diff…
Image RegistrationMedical Image RegistrationImproving Generalization of Meta-Learning With Inverted Regularization at Inner-Level
Despite the broad interest in meta-learning, the generalization problem remains one of the significant challenges in this field. Existing works focus on meta-generalization to unseen tasks at the meta-level by regula…
Meta-LearningMeta Learning with Minimax Regularization
Even though meta-learning has attracted research wide attention in recent years, the generalization problem of meta-learning is still not well addressed. Existing works focus on meta-generalization to unseen tasks at the…
Few-Shot LearningMeta-LearningMeta-forests: Domain generalization on random forests with meta-learning
Domain generalization is a popular machine learning technique that enables models to perform well on the unseen target domain, by learning from multiple source domains. Domain generalization is useful in cases where data…
Domain GeneralizationMeta-LearningObjectObject RecognitionSelf-supervised Meta-Prompt Learning with Meta-Gradient Regularization for Few-shot Generalization
Prompt tuning is a parameter-efficient method, which learns soft prompts and conditions frozen language models to perform specific downstream tasks. Though effective, prompt tuning under few-shot settings on the one hand…
Domain GeneralizationFew-Shot LearningMeta-LearningPrompt Learning