Enhancing Multiple-choice Machine Reading Comprehension by Punishing Illogical Interpretations
Machine Reading Comprehension (MRC), which requires a machine to answer questions given the relevant documents, is an important way to test machines’ ability to understand human language. Multiple-choice MRC is one of the most studied tasks in MRC due to the convenience of evaluation and the flexibility of answer format. Post-hoc interpretation aims to explain a trained model and reveal how the model arrives at the prediction. One of the most important interpretation forms is to attribute model decisions to input features. Based on post-hoc interpretation methods, we assess attributions of paragraphs in multiple-choice MRC and improve the model by punishing the illogical attributions. Our method can improve model performance without any external information and model structure change. Furthermore, we also analyze how and why such a self-training method works.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeMachine Reading ComprehensionMultiple-choiceReading ComprehensionSimilar Papers 제목 키워드 기반
Bridging Information-Seeking Human Gaze and Machine Reading Comprehension
In this work, we analyze how human gaze during reading comprehension is conditioned on the given reading comprehension question, and whether this signal can be beneficial for machine reading comprehension. To this end, w…
Machine Reading ComprehensionMultiple-choiceQuestion AnsweringReading ComprehensionAn Experimental Study of Deep Neural Network Models for Vietnamese Multiple-Choice Reading Comprehension
Machine reading comprehension (MRC) is a challenging task in natural language processing that makes computers understanding natural language texts and answer questions based on those texts. There are many techniques for …
Machine Reading ComprehensionMultiple-choiceReading ComprehensionWord EmbeddingsA Multiple Choices Reading Comprehension Corpus for Vietnamese Language Education
Machine reading comprehension has been an interesting and challenging task in recent years, with the purpose of extracting useful information from texts. To attain the computer ability to understand the reading text and …
ArticlesMachine Reading ComprehensionMultiple-choiceNatural Language Inference+1STARC: Structured Annotations for Reading Comprehension
We present STARC (Structured Annotations for Reading Comprehension), a new annotation framework for assessing reading comprehension with multiple choice questions. Our framework introduces a principled structure for the …
Multiple-choiceReading ComprehensionGenNet : Reading Comprehension with Multiple Choice Questions using Generation and Selection model
Multiple-choice machine reading comprehension is difficult task as its required machines to select the correct option from a set of candidate or possible options using the given passage and question.Reading Comprehension…
Answer GenerationMachine Reading ComprehensionMultiple-choiceReading Comprehension