ISS-MULT: Intelligent Sample Selection for Multi-Task Learning in Question Answering
Transferring knowledge from a source domain to another domain is useful, especially when gathering new data is very expensive and time-consuming. Deep networks have been well-studied for question answering tasks in recent years; however, no prominent research for transfer learning through deep neural networks exists in the question answering field. In this paper, two main methods (INIT and MULT) in this field are examined. Then, a new method named Intelligent sample selection (ISS-MULT) is proposed to improve the MULT method for question answering tasks. Different datasets, specificay SQuAD, SelQA, WikiQA, NewWikiQA and InforBoxQA, are used for evaluation. Moreover, two different tasks of question answering - answer selection and answer triggering - are evaluated to examine the effectiveness of transfer learning. The results show that using transfer learning generally improves the performance if the corpora are related and are based on the same policy. In addition, using ISS-MULT could finely improve the MULT method for question answering tasks, and these improvements prove more significant in the answer triggering task.
Code (0)
등록된 구현이 없습니다.
Tasks
Answer SelectionMulti-Task LearningQuestion AnsweringTransfer LearningSimilar Papers 제목 키워드 기반
Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation
To improve low-resource Neural Machine Translation (NMT) with multilingual corpora, training on the most related high-resource language only is often more effective than using all data available (Neubig and Hu, 2018). Ho…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationLow Resource NMTMachine Translation+3Informative Sample Selection Model for Skeleton-based Action Recognition with Limited Training Samples
Skeleton-based human action recognition aims to classify human skeletal sequences, which are spatiotemporal representations of actions, into predefined categories. To reduce the reliance on costly annotations of skeletal…
3D Action RecognitionActive LearningLarge Language Model-assisted Speech and Pointing Benefits Multiple 3D Object Selection in Virtual Reality
Selection of occluded objects is a challenging problem in virtual reality, even more so if multiple objects are involved. With the advent of new artificial intelligence technologies, we explore the possibility of leverag…
Language ModelingLanguage ModellingLarge Language ModelFeature selection algorithm based on incremental mutual information and cockroach swarm optimization
Feature selection is an effective preprocessing technique to reduce data dimension. For feature selection, rough set theory provides many measures, among which mutual information is one of the most important attribute me…
Attributefeature selectionSwish-Driven GoogleNet for Intelligent Analog Beam Selection in Terahertz Beamspace MIMO
In this paper, we propose an intelligent analog beam selection strategy in a terahertz (THz) band beamspace multiple-input multiple-output (MIMO) system. First inspired by transfer learning, we fine-tune the pre-trained …
Transfer Learning