Weighted Global Normalization for Multiple Choice Reading Comprehension over Long Documents
Motivated by recent evidence pointing out the fragility of high-performing span prediction models, we direct our attention to multiple choice reading comprehension. In particular, this work introduces a novel method for improving answer selection on long documents through weighted global normalization of predictions over portions of the documents. We show that applying our method to a span prediction model adapted for answer selection helps model performance on long summaries from NarrativeQA, a challenging reading comprehension dataset with an answer selection task, and we strongly improve on the task baseline performance by +36.2 Mean Reciprocal Rank.
Code (0)
등록된 구현이 없습니다.
Tasks
Answer SelectionMultiple-choicePredictionReading ComprehensionSimilar Papers 제목 키워드 기반
Increasing Probability Mass on Answer Choices Does Not Always Improve Accuracy
When pretrained language models (LMs) are applied to discriminative tasks such as multiple-choice questions, they place probability mass on vocabulary tokens that aren't among the given answer choices. Spreading probabil…
In-Context LearningMultiple-choicevalidCSReader at SemEval-2018 Task 11: Multiple Choice Question Answering as Textual Entailment
In this document we present an end-to-end machine reading comprehension system that solves multiple choice questions with a textual entailment perspective. Since some of the knowledge required is not explicitly mentioned…
Common Sense ReasoningLanguage ModellingMachine Reading ComprehensionMultiple-choice+4Analyzing Multiple-Choice Reading and Listening Comprehension Tests
Multiple-choice reading and listening comprehension tests are an important part of language assessment. Content creators for standard educational tests need to carefully curate questions that assess the comprehension abi…
Multiple-choiceReading ComprehensionWorld KnowledgeBranchShine: Compact Raw-Audio-to-IPA Transcription with a RoPE E-Branchformer Encoder
Speech-to-IPA transcription is useful when the desired output is pronunciation rather than orthographic text, but competitive multilingual systems are often large and evaluation is sensitive to normalization choices. Thi…
Assessing Distractors in Multiple-Choice Tests
Multiple-choice tests are a common approach for assessing candidates' comprehension skills. Standard multiple-choice reading comprehension exams require candidates to select the correct answer option from a discrete set …
DiversityMultiple-choiceReading Comprehension