EveMRC: A Two-stage Evidence Modeling For Multi-choice Machine Reading Comprehension
Many impressive works have been proposed to improve the performance of Machine Reading Comprehension (MRC) systems in recent years. However, it is still difficult to interpret the predictions of existing MRC models, which makes the predictions unconvincing. In this work, we propose a two-stage explainable framework for multi-choice MRC to model not only the correlation between answers and evidence, but also the competition among evidence. In stage 1, we select evidence sentences for both the right answer and wrong answers using the semi-supervised evidence selector. In stage 2, we employ an evidence discriminator to compare among the competitive evidence set and make final judgments. Moreover, we propose an evidence-enabled data augmentation method. Experiments on four multi-choice MRC datasets show that: stage 1 provides strong explainability for MRC systems and stage 2 improves both the performance and robustness of MRC systems meanwhile.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationMachine Reading ComprehensionMulti-Choice MRCReading ComprehensionSimilar Papers 제목 키워드 기반
Consider or Choose? The Role and Power of Consideration Sets
Consideration sets play a crucial role in discrete choice modeling, where customers often form consideration sets in the first stage and then use a second-stage choice mechanism to select the product with the highest uti…
Assortment OptimizationDecision MakingMarketingContext Modeling with Evidence Filter for Multiple Choice Question Answering
Multiple-Choice Question Answering (MCQA) is a challenging task in machine reading comprehension. The main challenge in MCQA is to extract "evidence" from the given context that supports the correct answer. In the Openbo…
Machine Reading ComprehensionMultiple-choiceMultiple Choice Question Answering (MCQA)Question Answering+1Geometric Attention: A Regime-Explicit Operator Semantics for Transformer Attention
Geometric Attention (GA) specifies an attention layer by four independent inputs: a finite carrier (what indices are addressable), an evidence-kernel rule (how masked proto-scores and a link induce nonnegative weights), …
On Estimating Multi-Attribute Choice Preferences using Private Signals and Matrix Factorization
Revealed preference theory studies the possibility of modeling an agent's revealed preferences and the construction of a consistent utility function. However, modeling agent's choices over preference orderings is not alw…
AttributeOptimizing sequential decisions in the drift-diffusion model
To make decisions organisms often accumulate information across multiple timescales. However, most experimental and modeling studies of decision-making focus on sequences of independent trials. On the other hand, natural…
Decision Makingmodel