Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documents
Interpretable multi-hop reading comprehension (RC) over multiple documents is a challenging problem because it demands reasoning over multiple information sources and explaining the answer prediction by providing supporting evidences. In this paper, we propose an effective and interpretable Select, Answer and Explain (SAE) system to solve the multi-document RC problem. Our system first filters out answer-unrelated documents and thus reduce the amount of distraction information. This is achieved by a document classifier trained with a novel pairwise learning-to-rank loss. The selected answer-related documents are then input to a model to jointly predict the answer and supporting sentences. The model is optimized with a multi-task learning objective on both token level for answer prediction and sentence level for supporting sentences prediction, together with an attention-based interaction between these two tasks. Evaluated on HotpotQA, a challenging multi-hop RC data set, the proposed SAE system achieves top competitive performance in distractor setting compared to other existing systems on the leaderboard.
Code (1)
Tasks
Learning-To-RankMulti-Hop Reading ComprehensionMulti-Task LearningPredictionReading ComprehensionSentenceSimilar Papers 제목 키워드 기반
Explore, Propose, and Assemble: An Interpretable Model for Multi-Hop Reading Comprehension
Multi-hop reading comprehension requires the model to explore and connect relevant information from multiple sentences/documents in order to answer the question about the context. To achieve this, we propose an interpret…
Multi-Hop Reading ComprehensionReading ComprehensionSentenceEveMRC: A Two-stage Evidence Modeling For Multi-choice Machine Reading Comprehension
Many impressive works have been proposed to improve the performance of Machine Reading Comprehension (MRC) systems in recent years. However, it is still difficult to interpret the predictions of existing MRC models, whic…
Data AugmentationMachine Reading ComprehensionMulti-Choice MRCReading ComprehensionEvaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension
To precisely evaluate a language model's capability for logical reading comprehension, we present a dataset for testing the understanding of the rationale behind critical reasoning. For questions taken from an existing m…
Multiple-choiceReading ComprehensionTowards Interpretable and Reliable Reading Comprehension: A Pipeline Model with Unanswerability Prediction
Multi-hop QA with annotated supporting facts, which is the task of reading comprehension (RC) considering the interpretability of the answer, has been extensively studied. In this study, we define an interpretable readin…
Reading ComprehensionViMultiChoice: Toward a Method That Gives Explanation for Multiple-Choice Reading Comprehension in Vietnamese
Multiple-choice Reading Comprehension (MCRC) models aim to select the correct answer from a set of candidate options for a given question. However, they typically lack the ability to explain the reasoning behind their ch…
Explanation GenerationReading Comprehension