Double Retrieval and Ranking for Accurate Question Answering
Recent work has shown that an answer verification step introduced in Transformer-based answer selection models can significantly improve the state of the art in Question Answering. This step is performed by aggregating the embeddings of top $k$ answer candidates to support the verification of a target answer. Although the approach is intuitive and sound still shows two limitations: (i) the supporting candidates are ranked only according to the relevancy with the question and not with the answer, and (ii) the support provided by the other answer candidates is suboptimal as these are retrieved independently of the target answer. In this paper, we address both drawbacks by proposing (i) a double reranking model, which, for each target answer, selects the best support; and (ii) a second neural retrieval stage designed to encode question and answer pair as the query, which finds more specific verification information. The results on three well-known datasets for AS2 show consistent and significant improvement of the state of the art.
Code (0)
등록된 구현이 없습니다.
Tasks
Answer SelectionQuestion AnsweringRerankingRetrievalSimilar Papers 제목 키워드 기반
Leveraging Visual Question Answering for Image-Caption Ranking
Visual Question Answering (VQA) is the task of taking as input an image and a free-form natural language question about the image, and producing an accurate answer. In this work we view VQA as a "feature extraction" modu…
Image RetrievalQuestion AnsweringRetrievalVisual Question Answering+1Beyond Retrieval: Joint Supervision and Multimodal Document Ranking for Textbook Question Answering
Textbook question answering (TQA) is a complex task, requiring the interpretation of complex multimodal context. Although recent advances have improved overall performance, they often encounter difficulties in educationa…
Document RankingLarge Language ModelMultimodal Large Language ModelQuestion Answering+2Efficient Passage Retrieval with Hashing for Open-domain Question Answering
Most state-of-the-art open-domain question answering systems use a neural retrieval model to encode passages into continuous vectors and extract them from a knowledge source. However, such retrieval models often require …
Natural QuestionsOpen-Domain Question AnsweringPassage RetrievalQuestion Answering+3Knowledge-Aided Open-Domain Question Answering
Open-domain question answering (QA) aims to find the answer to a question from a large collection of documents.Though many models for single-document machine comprehension have achieved strong performance, there is still…
Open-Domain Question AnsweringQuestion AnsweringReading ComprehensionReranking+1Cooperative Retrieval-Augmented Generation for Question Answering: Mutual Information Exchange and Ranking by Contrasting Layers
Since large language models (LLMs) have a tendency to generate factually inaccurate output, retrieval-augmented generation (RAG) has gained significant attention as a key means to mitigate this downside of harnessing onl…
Multi-hop Question Answering