Latent Space Embedding for Retrieval in Question-Answer Archives
Community-driven Question Answering (CQA) systems such as Yahoo! Answers have become valuable sources of reusable information. CQA retrieval enables usage of historical CQA archives to solve new questions posed by users. This task has received much recent attention, with methods building upon literature from translation models, topic models, and deep learning. In this paper, we devise a CQA retrieval technique, LASER-QA, that embeds question-answer pairs within a unified latent space preserving the local neighborhood structure of question and answer spaces. The idea is that such a space mirrors semantic similarity among questions as well as answers, thereby enabling high quality retrieval. Through an empirical analysis on various real-world QA datasets, we illustrate the improved effectiveness of LASER-QA over state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringRetrievalSemantic SimilaritySemantic Textual SimilarityTopic ModelsTranslationSimilar Papers 제목 키워드 기반
Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentation
Neural models that independently project questions and answers into a shared embedding space allow for efficient continuous space retrieval from large corpora. Independently computing embeddings for questions and answers…
Data AugmentationQuestion AnsweringRetrievalBeyond Prompting: An Efficient Embedding Framework for Open-Domain Question Answering
Large language models have recently pushed open domain question answering (ODQA) to new frontiers. However, prevailing retriever-reader pipelines often depend on multiple rounds of prompt level instructions, leading to h…
Contrastive LearningOpen-Domain Question AnsweringQuestion AnsweringRetrievalHyperbolic Representation Learning for Fast and Efficient Neural Question Answering
The dominant neural architectures in question answer retrieval are based on recurrent or convolutional encoders configured with complex word matching layers. Given that recent architectural innovations are mostly new wor…
Efficient Neural NetworkFeature EngineeringQuestion AnsweringRepresentation Learning+1QuOTE: Question-Oriented Text Embeddings
We present QuOTE (Question-Oriented Text Embeddings), a novel enhancement to retrieval-augmented generation (RAG) systems, aimed at improving document representation for accurate and nuanced retrieval. Unlike traditional…
Multi-hop Question AnsweringQuestion AnsweringQuestion GenerationQuestion-Generation+3Text Embeddings for Retrieval From a Large Knowledge Base
Text embedding representing natural language documents in a semantic vector space can be used for document retrieval using nearest neighbor lookup. In order to study the feasibility of neural models specialized for retri…
Open-Domain Question AnsweringQuestion AnsweringRetrieval