MCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledge
We introduce a large dataset of narrative texts and questions about these texts, intended to be used in a machine comprehension task that requires reasoning using commonsense knowledge. Our dataset complements similar datasets in that we focus on stories about everyday activities, such as going to the movies or working in the garden, and that the questions require commonsense knowledge, or more specifically, script knowledge, to be answered. We show that our mode of data collection via crowdsourcing results in a substantial amount of such inference questions. The dataset forms the basis of a shared task on commonsense and script knowledge organized at SemEval 2018 and provides challenging test cases for the broader natural language understanding community.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language UnderstandingReading ComprehensionSimilar Papers 제목 키워드 기반
MCScript2.0: A Machine Comprehension Corpus Focused on Script Events and Participants
We introduce MCScript2.0, a machine comprehension corpus for the end-to-end evaluation of script knowledge. MCScript2.0 contains approx. 20,000 questions on approx. 3,500 texts, crowdsourced based on a new collection pro…
Reading ComprehensionBLCU-NLP at COIN-Shared Task1: Stagewise Fine-tuning BERT for Commonsense Inference in Everyday Narrations
This paper describes our system for COIN Shared Task 1: Commonsense Inference in Everyday Narrations. To inject more external knowledge to better reason over the narrative passage, question and answer, the system adopts …
Machine Reading ComprehensionReading ComprehensionSemEval-2018 Task 11: Machine Comprehension Using Commonsense Knowledge
This report summarizes the results of the SemEval 2018 task on machine comprehension using commonsense knowledge. For this machine comprehension task, we created a new corpus, MCScript. It contains a high number of quest…
Reading ComprehensionStory CompletionWhat does BERT Learn from Multiple-Choice Reading Comprehension Datasets?
Multiple-Choice Reading Comprehension (MCRC) requires the model to read the passage and question, and select the correct answer among the given options. Recent state-of-the-art models have achieved impressive performance…
Multiple-choiceReading ComprehensionMulti-Perspective Fusion Network for Commonsense Reading Comprehension
Commonsense Reading Comprehension (CRC) is a significantly challenging task, aiming at choosing the right answer for the question referring to a narrative passage, which may require commonsense knowledge inference. Most …
Reading Comprehension