Knowledge Based Machine Reading Comprehension
Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world. However, existing datasets are typically dominated by questions that can be well solved by context matching, which fail to test this capability. To encourage the progress on knowledge-based reasoning in MRC, we present knowledge-based MRC in this paper, and build a new dataset consisting of 40,047 question-answer pairs. The annotation of this dataset is designed so that successfully answering the questions requires understanding and the knowledge involved in a document. We implement a framework consisting of both a question answering model and a question generation model, both of which take the knowledge extracted from the document as well as relevant facts from an external knowledge base such as Freebase/ProBase/Reverb/NELL. Results show that incorporating side information from external KB improves the accuracy of the baseline question answer system. We compare it with a standard MRC model BiDAF, and also provide the difficulty of the dataset and lay out remaining challenges.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Reading ComprehensionQuestion AnsweringQuestion GenerationQuestion-GenerationReading ComprehensionSimilar Papers 제목 키워드 기반
Neural Network-based Models with Commonsense Knowledge for Machine Reading Comprehension
State-of-the-art machine reading comprehension models are capable of producing answers for factual questions about a given piece of text. However, some type of questions requires commonsense knowledge which cannot be inf…
Machine Reading ComprehensionReading ComprehensionScene Restoring for Narrative Machine Reading Comprehension
This paper focuses on machine reading comprehension for narrative passages. Narrative passages usually describe a chain of events. When reading this kind of passage, humans tend to restore a scene according to the text w…
Cloze TestMachine Reading ComprehensionMultiple-choiceReading ComprehensionA Chinese Machine Reading Comprehension Dataset Automatic Generated Based on Knowledge Graph
“Machine reading comprehension (MRC) is a typical natural language processing (NLP)task and has developed rapidly in the last few years. Various reading comprehension datasets have been built to support MRC studies. Howe…
Dataset GenerationMachine Reading ComprehensionReading ComprehensionReading Comprehension Ability Test-A Turing Test for Reading Comprehension
Reading comprehension is an important ability of human intelligence. Literacy and numeracy are two most essential foundation for people to succeed at study, at work and in life. Reading comprehension ability is a core co…
Reading ComprehensionBuilding Dynamic Knowledge Graphs from Text using Machine Reading Comprehension
We propose a neural machine-reading model that constructs dynamic knowledge graphs from procedural text. It builds these graphs recurrently for each step of the described procedure, and uses them to track the evolving st…
Knowledge GraphsMachine Reading ComprehensionProcedural Text UnderstandingQuestion Answering+1