Autonomous Source Knowledge Selection in Multi-Domain Adaptation
Unsupervised multi-domain adaptation plays a key role in transfer learning by leveraging acquired rich source information from multiple source domains to solve target task from an unlabeled target domain. However, multiple source domains often contain much redundant or unrelated information which can harm transfer performance, especially when in massive-source domain settings. It is urgent to develop effective strategies for identifying and selecting the most transferable knowledge from massive source domains to address the target task. In this paper, we propose a multi-domain adaptation method named \underline{\textit{Auto}}nomous Source Knowledge \underline{\textit{S}}election (AutoS) to autonomosly select source training samples and models, enabling the prediction of target task using more relevant and transferable source information. The proposed method employs a density-driven selection strategy to choose source samples during training and to determine which source models should contribute to target prediction. Simulteneously, a pseudo-label enhancement module built on a pre-trained multimodal modal is employed to mitigate target label noise and improve self-supervision. Experiments on real-world datasets indicate the superiority of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Transfer LearningDomain AdaptationSimilar Papers 제목 키워드 기반
Multi-Sentence Knowledge Selection in Open-Domain Dialogue
Incorporating external knowledge sources effectively in conversations is a longstanding problem in open-domain dialogue research. The existing literature on open-domain knowledge selection is limited and makes certain br…
SentenceKnowledge as A Bridge: Improving Cross-domain Answer Selection with External Knowledge
Answer selection is an important but challenging task. Significant progresses have been made in domains where a large amount of labeled training data is available. However, obtaining rich annotated data is a time-consumi…
Answer SelectionInformation RetrievalQuestion AnsweringReading Comprehension+1A Knowledge Plug-and-Play Test Bed for Open-domain Dialogue Generation
Knowledge-based, open-domain dialogue generation aims to build chit-chat systems that talk to humans using mined support knowledge. Many types and sources of knowledge have previously been shown to be useful as support k…
Dialogue GenerationResponse GenerationSource data selection for out-of-domain generalization
Models that perform out-of-domain generalization borrow knowledge from heterogeneous source data and apply it to a related but distinct target task. Transfer learning has proven effective for accomplishing this generaliz…
Domain GeneralizationTransfer LearningSETrLUSI: Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant
In transfer learning, a source domain often carries diverse knowledge, and different domains usually emphasize different types of knowledge. Different from handling only a single type of knowledge from all domains in tra…
Ensemble LearningTransfer Learning