Learning to Rank Question Answer Pairs with Holographic Dual LSTM Architecture
We describe a new deep learning architecture for learning to rank question answer pairs. Our approach extends the long short-term memory (LSTM) network with holographic composition to model the relationship between question and answer representations. As opposed to the neural tensor layer that has been adopted recently, the holographic composition provides the benefits of scalable and rich representational learning approach without incurring huge parameter costs. Overall, we present Holographic Dual LSTM (HD-LSTM), a unified architecture for both deep sentence modeling and semantic matching. Essentially, our model is trained end-to-end whereby the parameters of the LSTM are optimized in a way that best explains the correlation between question and answer representations. In addition, our proposed deep learning architecture requires no extensive feature engineering. Via extensive experiments, we show that HD-LSTM outperforms many other neural architectures on two popular benchmark QA datasets. Empirical studies confirm the effectiveness of holographic composition over the neural tensor layer.
Code (1)
Tasks
Feature EngineeringLearning-To-RankSentenceSimilar Papers 제목 키워드 기반
Pre-training, Fine-tuning and Re-ranking: A Three-Stage Framework for Legal Question Answering
Legal question answering (QA) has attracted increasing attention from people seeking legal advice, which aims to retrieve the most applicable answers from a large-scale database of question-answer pairs. Previous methods…
Question AnsweringRepresentation LearningRe-RankingLearning to Rank Question Answer Pairs with Bilateral Contrastive Data Augmentation
In this work, we propose a novel and easy-to-apply data augmentation strategy, namely Bilateral Generation (BiG), with a contrastive training objective for improving the performance of ranking question answer pairs with …
Answer GenerationData AugmentationLearning-To-RankQuestion Generation+1GW\_QA at SemEval-2017 Task 3: Question Answer Re-ranking on Arabic Fora
This paper describes our submission to SemEval-2017 Task 3 Subtask D, {``}Question Answer Ranking in Arabic Community Question Answering{''}. In this work, we applied a supervised machine learning approach to automatical…
Answer SelectionBIG-bench Machine LearningCommunity Question AnsweringQuestion Answering+1QUADRo: Dataset and Models for QUestion-Answer Database Retrieval
An effective paradigm for building Automated Question Answering systems is the re-use of previously answered questions, e.g., for FAQs or forum applications. Given a database (DB) of question/answer (q/a) pairs, it is po…
Question AnsweringRerankingRetrievalRetrieving and Ranking Similar Questions from Question-Answer Archives Using Topic Modelling and Topic Distribution Regression
Presented herein is a novel model for similar question ranking within collaborative question answer platforms. The presented approach integrates a regression stage to relate topics derived from questions to those derived…
regressionTranslation