A Case Based Reasoning Approach for Answer Reranking in Question Answering
In this document I present an approach to answer validation and reranking for question answering (QA) systems. A cased-based reasoning (CBR) system judges answer candidates for questions from annotated answer candidates for earlier questions. The promise of this approach is that user feedback will result in improved answers of the QA system, due to the growing case base. In the paper, I present the adequate structuring of the case base and the appropriate selection of relevant similarity measures, in order to solve the answer validation problem. The structural case base is built from annotated MultiNet graphs, which provide representations for natural language expressions, and corresponding graph similarity measures. I cover a priori relations to experienced answer candidates for former questions. I compare the CBR System results to current approaches in an experiment integrating CBR into an existing framework for answer validation and reranking. This integration is achieved by adding CBR-related features to the input of a learned ranking model that determines the final answer ranking. In the experiments based on QA@CLEF questions, the best learned models make heavy use of CBR features. Observing the results with a continually growing case base, I present a positive effect of the size of the case base on the accuracy of the CBR subsystem.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph SimilarityQuestion AnsweringRerankingSimilar Papers 제목 키워드 기반
Answering Any-hop Open-domain Questions with Iterative Document Reranking
Existing approaches for open-domain question answering (QA) are typically designed for questions that require either single-hop or multi-hop reasoning, which make strong assumptions of the complexity of questions to be a…
Multi-hop Question AnsweringNatural QuestionsOpen-Domain Question AnsweringQuestion Answering+2Multimodal Reranking for Knowledge-Intensive Visual Question Answering
Knowledge-intensive visual question answering requires models to effectively use external knowledge to help answer visual questions. A typical pipeline includes a knowledge retriever and an answer generator. However, a r…
Answer GenerationQuestion AnsweringRerankingVisual Question Answering+1Knowledge-Aided Open-Domain Question Answering
Open-domain question answering (QA) aims to find the answer to a question from a large collection of documents.Though many models for single-document machine comprehension have achieved strong performance, there is still…
Open-Domain Question AnsweringQuestion AnsweringReading ComprehensionReranking+1Modeling Contextual Passage Utility for Multihop Question Answering
Multihop Question Answering (QA) requires systems to identify and synthesize information from multiple text passages. While most prior retrieval methods assist in identifying relevant passages for QA, further assessing t…
Question AnsweringPassage-specific Prompt Tuning for Passage Reranking in Question Answering with Large Language Models
Effective passage retrieval and reranking methods have been widely utilized to identify suitable candidates in open-domain question answering tasks, recent studies have resorted to LLMs for reranking the retrieved passag…
Open-Domain Question AnsweringPassage RerankingPassage RetrievalQuestion Answering+1