Answer Span Correction in Machine Reading Comprehension
Answer validation in machine reading comprehension (MRC) consists of verifying an extracted answer against an input context and question pair. Previous work has looked at re-assessing the "answerability" of the question given the extracted answer. Here we address a different problem: the tendency of existing MRC systems to produce partially correct answers when presented with answerable questions. We explore the nature of such errors and propose a post-processing correction method that yields statistically significant performance improvements over state-of-the-art MRC systems in both monolingual and multilingual evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Reading ComprehensionReading ComprehensionSimilar Papers 제목 키워드 기반
To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning
Machine Reading Comprehension with Unanswerable Questions is a difficult NLP task, challenged by the questions which can not be answered from passages. It is observed that subtle literal changes often make an answerable …
Contrastive LearningMachine Reading ComprehensionReading ComprehensionSTARC: Structured Annotations for Reading Comprehension
We present STARC (Structured Annotations for Reading Comprehension), a new annotation framework for assessing reading comprehension with multiple choice questions. Our framework introduces a principled structure for the …
Multiple-choiceReading ComprehensionSpans, Not Tokens: A Span-Centric Model for Multi-Span Reading Comprehension
Multi-span reading comprehension (MSRC) requires machines to extract multiple non-contiguous spans from a given context to answer a question. Existing MSRC methods either predict the positions of the start and end tokens…
Reading ComprehensionTAGS-Net: From Answer Extraction to Answer Generation for Machine Reading Comprehension
In this paper, we present a novel approach to machine reading comprehension for the MS-MARCO dataset. Unlike the SQuAD dataset that aims to answer a question with exact text spans in a passage, the MS-MARCO dataset defin…
Answer GenerationMachine Reading ComprehensionPassage RankingReading ComprehensionNo Answer is Better Than Wrong Answer: A Reflection Model for Document Level Machine Reading Comprehension
The Natural Questions (NQ) benchmark set brings new challenges to Machine Reading Comprehension: the answers are not only at different levels of granularity (long and short), but also of richer types (including no-answer…
Machine Reading ComprehensionNatural QuestionsReading Comprehension