Reference Knowledgeable Network for Machine Reading Comprehension
Multi-choice Machine Reading Comprehension (MRC) as a challenge requires models to select the most appropriate answer from a set of candidates with a given passage and question. Most of the existing researches focus on the modeling of specific tasks or complex networks, without explicitly referring to relevant and credible external knowledge sources, which are supposed to greatly make up for the deficiency of the given passage. Thus we propose a novel reference-based knowledge enhancement model called Reference Knowledgeable Network (RekNet), which simulates human reading strategies to refine critical information from the passage and quote explicit knowledge in necessity. In detail, RekNet refines finegrained critical information and defines it as Reference Span, then quotes explicit knowledge quadruples by the co-occurrence information of Reference Span and candidates. The proposed RekNet is evaluated on three multi-choice MRC benchmarks: RACE, DREAM and Cosmos QA, obtaining consistent and remarkable performance improvement with observable statistical significance level over strong baselines. Our code is available at https://github.com/Yilin1111/RekNet.
Code (1)
Tasks
Machine Reading ComprehensionMulti-Choice MRCReading ComprehensionSimilar Papers 제목 키워드 기반
Sharing, Teaching and Aligning: Knowledgeable Transfer Learning for Cross-Lingual Machine Reading Comprehension
In cross-lingual language understanding, machine translation is often utilized to enhance the transferability of models across languages, either by translating the training data from the source language to the target, or…
Cross-Lingual TransferMachine Reading ComprehensionMachine TranslationReading Comprehension+1Step out of KG: Knowledge Graph Completion via Knowledgeable Retrieval and Reading Comprehension
Knowledge graphs, as the cornerstone of many AI applications, usually face serious incompleteness problems. In recent years, there have been many efforts to study automatic knowledge graph completion (KGC), most of which…
Information RetrievalKnowledge Graph CompletionKnowledge GraphsReading Comprehension+1Knowledgeable Dialogue Reading Comprehension on Key Turns
Multi-choice machine reading comprehension (MRC) requires models to choose the correct answer from candidate options given a passage and a question. Our research focuses dialogue-based MRC, where the passages are multi-t…
Answer SelectionLanguage ModelingLanguage ModellingMachine Reading Comprehension+1Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledge
We introduce a neural reading comprehension model that integrates external commonsense knowledge, encoded as a key-value memory, in a cloze-style setting. Instead of relying only on document-to-question interaction or di…
Reading ComprehensionQuoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoning
Machine comprehension of texts longer than a single sentence often requires coreference resolution. However, most current reading comprehension benchmarks do not contain complex coreferential phenomena and hence fail to …
coreference-resolutionCoreference ResolutionReading ComprehensionSentence