Improving the Question Answering Quality using Answer Candidate Filtering based on Natural-Language Features
Software with natural-language user interfaces has an ever-increasing importance. However, the quality of the included Question Answering (QA) functionality is still not sufficient regarding the number of questions that are answered correctly. In our work, we address the research problem of how the QA quality of a given system can be improved just by evaluating the natural-language input (i.e., the user's question) and output (i.e., the system's answer). Our main contribution is an approach capable of identifying wrong answers provided by a QA system. Hence, filtering incorrect answers from a list of answer candidates is leading to a highly improved QA quality. In particular, our approach has shown its potential while removing in many cases the majority of incorrect answers, which increases the QA quality significantly in comparison to the non-filtered output of a system.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringSimilar Papers 제목 키워드 기반
Answer Candidate Type Selection: Text-to-Text Language Model for Closed Book Question Answering Meets Knowledge Graphs
Pre-trained Text-to-Text Language Models (LMs), such as T5 or BART yield promising results in the Knowledge Graph Question Answering (KGQA) task. However, the capacity of the models is limited and the quality decreases f…
Graph Question AnsweringKnowledge GraphsLanguage ModelingLanguage Modelling+2Exploring the Role of Logically Related Non-Question Phrases for Answering Why-Questions
In this paper, we show that certain phrases although not present in a given question/query, play a very important role in answering the question. Exploring the role of such phrases in answering questions not only reduces…
Answer Generation for Retrieval-based Question Answering Systems
Recent advancements in transformer-based models have greatly improved the ability of Question Answering (QA) systems to provide correct answers; in particular, answer sentence selection (AS2) models, core components of r…
Answer GenerationQuestion AnsweringRetrievalSentenceMultimodal Reranking for Knowledge-Intensive Visual Question Answering
Knowledge-intensive visual question answering requires models to effectively use external knowledge to help answer visual questions. A typical pipeline includes a knowledge retriever and an answer generator. However, a r…
Answer GenerationQuestion AnsweringRerankingVisual Question Answering+1OVQA: A Clinically Generated Visual Question Answering Dataset
Medical visual question answering (Med-VQA) is a challenging problem that aims to take a medical image and a clinical question about the image as input and output a correct answer in natural language. Current medical sys…
BenchmarkingMedical Visual Question AnsweringQuestion AnsweringVisual Question Answering+1