Context Modeling with Evidence Filter for Multiple Choice Question Answering
Multiple-Choice Question Answering (MCQA) is a challenging task in machine reading comprehension. The main challenge in MCQA is to extract "evidence" from the given context that supports the correct answer. In the OpenbookQA dataset, the requirement of extracting "evidence" is particularly important due to the mutual independence of sentences in the context. Existing work tackles this problem by annotated evidence or distant supervision with rules which overly rely on human efforts. To address the challenge, we propose a simple yet effective approach termed evidence filtering to model the relationships between the encoded contexts with respect to different options collectively and to potentially highlight the evidence sentences and filter out unrelated sentences. In addition to the effective reduction of human efforts of our approach compared, through extensive experiments on OpenbookQA, we show that the proposed approach outperforms the models that use the same backbone and more training data; and our parameter analysis also demonstrates the interpretability of our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Reading ComprehensionMultiple-choiceMultiple Choice Question Answering (MCQA)Question AnsweringReading ComprehensionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Simultaneous Localization and Mapping: Through the Lens of Nonlinear Optimization
Simultaneous Localization and Mapping (SLAM) algorithms perform visual-inertial estimation via filtering or batch optimization methods. Empirical evidence suggests that filtering algorithms are computationally faster, wh…
Simultaneous Localization and MappingReFilter: Improving Robustness of Retrieval-Augmented Generation via Gated Filter
Retrieval-augmented generation (RAG) has become a dominant paradigm for grounding large language models (LLMs) with external evidence in knowledge-intensive question answering. A core design choice is how to fuse retriev…
Question AnsweringDomain AdaptationOn the choice of training data for machine learning of geostrophic mesoscale turbulence
'Data' plays a central role in data-driven methods, but is not often the subject of focus in investigations of machine learning algorithms as applied to Earth System Modeling related problems. Here we consider the case o…
Filtering Down to Size: A Theory of Consideration
The standard rational choice model describes individuals as making choices by selecting the best option from a menu. A wealth of evidence instead suggests that individuals often filter menus into smaller sets - considera…
Context Filtering with Reward Modeling in Question Answering
Question Answering (QA) in NLP is the task of finding answers to a query within a relevant context retrieved by a retrieval system. Yet, the mix of relevant and irrelevant information in these contexts can hinder perform…
Question Answering