Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation
Domain adaptation (DA) is the topical problem of adapting models from labelled source datasets so that they perform well on target datasets where only unlabelled or partially labelled data is available. Many methods have been proposed to address this problem through different ways to minimise the domain shift between source and target datasets. In this paper we take an orthogonal perspective and propose a framework to further enhance performance by meta-learning the initial conditions of existing DA algorithms. This is challenging compared to the more widely considered setting of few-shot meta-learning, due to the length of the computation graph involved. Therefore we propose an online shortest-path meta-learning framework that is both computationally tractable and practically effective for improving DA performance. We present variants for both multi-source unsupervised domain adaptation (MSDA), and semi-supervised domain adaptation (SSDA). Importantly, our approach is agnostic to the base adaptation algorithm, and can be applied to improve many techniques. Experimentally, we demonstrate improvements on classic (DANN) and recent (MCD and MME) techniques for MSDA and SSDA, and ultimately achieve state of the art results on several DA benchmarks including the largest scale DomainNet.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationMeta-LearningMMEMulti-Source Unsupervised Domain AdaptationSemi-supervised Domain AdaptationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Semi-Supervised Variational Inference over Nonlinear Channels
Deep learning methods for communications over unknown nonlinear channels have attracted considerable interest recently. In this paper, we consider semi-supervised learning methods, which are based on variational inferenc…
Meta-LearningVariational InferenceTowards Low-Resource Semi-Supervised Dialogue Generation with Meta-Learning
In this paper, we propose a meta-learning based semi-supervised explicit dialogue state tracker (SEDST) for neural dialogue generation, denoted as MEDST. Our main motivation is to further bridge the chasm between the nee…
Dialogue GenerationMeta-LearningDomain Generalization via Semi-supervised Meta Learning
The goal of domain generalization is to learn from multiple source domains to generalize to unseen target domains under distribution discrepancy. Current state-of-the-art methods in this area are fully supervised, but fo…
Domain GeneralizationMeta-LearningMeta-Semi: A Meta-learning Approach for Semi-supervised Learning
Deep learning based semi-supervised learning (SSL) algorithms have led to promising results in recent years. However, they tend to introduce multiple tunable hyper-parameters, making them less practical in real SSL scena…
Meta-LearningFinding Structure in Figurative Language: Metaphor Detection with Topic-based Frames
In this paper, we present a novel and highly effective method for induction and application of metaphor frame templates as a step toward detecting metaphor in extended discourse. We infer implicit facets of a given metap…
BIG-bench Machine LearningMachine Translation