Effective shared representations with Multitask Learning for Community Question Answering
An important asset of using Deep Neural Networks (DNNs) for text applications is their ability to automatically engineering features. Unfortunately, DNNs usually require a lot of training data, especially for highly semantic tasks such as community Question Answering (cQA). In this paper, we tackle the problem of data scarcity by learning the target DNN together with two auxiliary tasks in a multitask learning setting. We exploit the strong semantic connection between selection of comments relevant to (i) new questions and (ii) forum questions. This enables a global representation for comments, new and previous questions. The experiments of our model on a SemEval challenge dataset for cQA show a 20{\%} of relative improvement over standard DNNs.
Code (0)
등록된 구현이 없습니다.
Tasks
Community Question AnsweringDocument RankingNamed Entity Recognition (NER)Question AnsweringSimilar Papers 제목 키워드 기반
Deep Asymmetric Multi-task Feature Learning
We propose Deep Asymmetric Multitask Feature Learning (Deep-AMTFL) which can learn deep representations shared across multiple tasks while effectively preventing negative transfer that may happen in the feature sharing p…
image-classificationImage ClassificationTransfer LearningLearning Representation for Multitask learning through Self Supervised Auxiliary learning
Multi-task learning is a popular machine learning approach that enables simultaneous learning of multiple related tasks, improving algorithmic efficiency and effectiveness. In the hard parameter sharing approach, an enco…
Auxiliary LearningComputational EfficiencyMulti-Task LearningMultitask Learning with Deep Neural Networks for Community Question Answering
In this paper, we developed a deep neural network (DNN) that learns to solve simultaneously the three tasks of the cQA challenge proposed by the SemEval-2016 Task 3, i.e., question-comment similarity, question-question s…
Community Question AnsweringFeature EngineeringQuestion AnsweringQuestion SimilarityJoint Multitask Learning for Community Question Answering Using Task-Specific Embeddings
We address jointly two important tasks for Question Answering in community forums: given a new question, (i) find related existing questions, and (ii) find relevant answers to this new question. We further use an auxilia…
Community Question AnsweringQuestion AnsweringNavigating the Trade-Off between Multi-Task Learning and Learning to Multitask in Deep Neural Networks
The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tas…
Meta-LearningMulti-Task Learning