Domain-Generalization to Improve Learning in Meta-Learning Algorithms
This paper introduces Domain Generalization Sharpness-Aware Minimization Model-Agnostic Meta-Learning (DGS-MAML), a novel meta-learning algorithm designed to generalize across tasks with limited training data. DGS-MAML combines gradient matching with sharpness-aware minimization in a bi-level optimization framework to enhance model adaptability and robustness. We support our method with theoretical analysis using PAC-Bayes and convergence guarantees. Experimental results on benchmark datasets show that DGS-MAML outperforms existing approaches in terms of accuracy and generalization. The proposed method is particularly useful for scenarios requiring few-shot learning and quick adaptation, and the source code is publicly available at GitHub.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain GeneralizationFew-Shot LearningSimilar Papers 제목 키워드 기반
Improving Generalization of Meta-Learning With Inverted Regularization at Inner-Level
Despite the broad interest in meta-learning, the generalization problem remains one of the significant challenges in this field. Existing works focus on meta-generalization to unseen tasks at the meta-level by regula…
Meta-LearningMeta-Learning for Domain Generalization in Semantic Parsing
The importance of building semantic parsers which can be applied to new domains and generate programs unseen at training has long been acknowledged, and datasets testing out-of-domain performance are becoming increasingl…
Domain GeneralizationMeta-LearningSemantic ParsingDiscriminative Adversarial Domain Generalization with Meta-learning based Cross-domain Validation
The generalization capability of machine learning models, which refers to generalizing the knowledge for an "unseen" domain via learning from one or multiple seen domain(s), is of great importance to develop and deploy m…
BIG-bench Machine LearningDomain GeneralizationMeta-LearningContext-Aware Self-Adaptation for Domain Generalization
Domain generalization aims at developing suitable learning algorithms in source training domains such that the model learned can generalize well on a different unseen testing domain. We present a novel two-stage approach…
Domain GeneralizationCompound Domain Generalization via Meta-Knowledge Encoding
Domain generalization (DG) aims to improve the generalization performance for an unseen target domain by using the knowledge of multiple seen source domains. Mainstream DG methods typically assume that the domain label o…
Domain GeneralizationOut-of-Distribution Generalization