Word Embedding based Correlation Model for Question/Answer Matching
With the development of community based question answering (Q&A) services, a large scale of Q&A archives have been accumulated and are an important information and knowledge resource on the web. Question and answer matching has been attached much importance to for its ability to reuse knowledge stored in these systems: it can be useful in enhancing user experience with recurrent questions. In this paper, we try to improve the matching accuracy by overcoming the lexical gap between question and answer pairs. A Word Embedding based Correlation (WEC) model is proposed by integrating advantages of both the translation model and word embedding, given a random pair of words, WEC can score their co-occurrence probability in Q&A pairs and it can also leverage the continuity and smoothness of continuous space word representation to deal with new pairs of words that are rare in the training parallel text. An experimental study on Yahoo! Answers dataset and Baidu Zhidao dataset shows this new method's promising potential.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringTranslationSimilar Papers 제목 키워드 기반
Question Answering over Freebase via Attentive RNN with Similarity Matrix based CNN
With the rapid growth of knowledge bases (KBs), question answering over knowledge base, a.k.a. KBQA has drawn huge attention in recent years. Most of the existing KBQA methods follow so called encoder-compare framework. …
Question AnsweringAnswer-focused and Position-aware Neural Question Generation
In this paper, we focus on the problem of question generation (QG). Recent neural network-based approaches employ the sequence-to-sequence model which takes an answer and its context as input and generates a relevant que…
Machine Reading ComprehensionPositionQuestion AnsweringQuestion Generation+2Generative Question Refinement with Deep Reinforcement Learning in Retrieval-based QA System
In real-world question-answering (QA) systems, ill-formed questions, such as wrong words, ill word order, and noisy expressions, are common and may prevent the QA systems from understanding and answering them accurately.…
Deep Reinforcement LearningQuestion Answeringreinforcement-learningReinforcement Learning+3Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering
The dominant neural architectures in question answer retrieval are based on recurrent or convolutional encoders configured with complex word matching layers. Given that recent architectural innovations are mostly new wor…
Efficient Neural NetworkFeature EngineeringQuestion AnsweringRepresentation Learning+1Quantum Language Model with Entanglement Embedding for Question Answering
Quantum Language Models (QLMs) in which words are modelled as quantum superposition of sememes have demonstrated a high level of model transparency and good post-hoc interpretability. Nevertheless, in the current literat…
Language ModelingLanguage ModellingQuestion Answering