An Unsupervised Model with Attention Autoencoders for Question Retrieval
Question retrieval is a crucial subtask for community question answering. Previous research focus on supervised models which depend heavily on training data and manual feature engineering. In this paper, we propose a novel unsupervised framework, namely reduced attentive matching network (RAMN), to compute semantic matching between two questions. Our RAMN integrates together the deep semantic representations, the shallow lexical mismatching information and the initial rank produced by an external search engine. For the first time, we propose attention autoencoders to generate semantic representations of questions. In addition, we employ lexical mismatching to capture surface matching between two questions, which is derived from the importance of each word in a question. We conduct experiments on the open CQA datasets of SemEval-2016 and SemEval-2017. The experimental results show that our unsupervised model obtains comparable performance with the state-of-the-art supervised methods in SemEval-2016 Task 3, and outperforms the best system in SemEval-2017 Task 3 by a wide margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Community Question AnsweringFeature EngineeringQuestion AnsweringRetrievalSimilar Papers 제목 키워드 기반
Learning Product Codebooks using Vector Quantized Autoencoders for Image Retrieval
Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for r…
Image RetrievalQuantizationRepresentation LearningRetrievalImproving Passage Retrieval with Zero-Shot Question Generation
We propose a simple and effective re-ranking method for improving passage retrieval in open question answering. The re-ranker re-scores retrieved passages with a zero-shot question generation model, which uses a pre-trai…
Language ModelingLanguage ModellingOpen-Domain Question AnsweringOpen-Ended Question Answering+6Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation
Text autoencoders are often used for unsupervised conditional text generation by applying mappings in the latent space to change attributes to the desired values. Recently, Mai et al. (2020) proposed Emb2Emb, a method to…
Conditional Text GenerationSentence SummarizationText GenerationCrossing Variational Autoencoders for Answer Retrieval
Answer retrieval is to find the most aligned answer from a large set of candidates given a question. Learning vector representations of questions/answers is the key factor. Question-answer alignment and question/answer s…
RetrievalReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chains
The ability of reasoning over evidence has received increasing attention in question answering (QA). Recently, natural language database (NLDB) conducts complex QA in knowledge base with textual evidences rather than str…
Answer GenerationDiversityQuestion AnsweringRetrieval