Reasoning with Heterogeneous Knowledge for Commonsense Machine Comprehension
Reasoning with commonsense knowledge is critical for natural language understanding. Traditional methods for commonsense machine comprehension mostly only focus on one specific kind of knowledge, neglecting the fact that commonsense reasoning requires simultaneously considering different kinds of commonsense knowledge. In this paper, we propose a multi-knowledge reasoning method, which can exploit heterogeneous knowledge for commonsense machine comprehension. Specifically, we first mine different kinds of knowledge (including event narrative knowledge, entity semantic knowledge and sentiment coherent knowledge) and encode them as inference rules with costs. Then we propose a multi-knowledge reasoning model, which selects inference rules for a specific reasoning context using attention mechanism, and reasons by summarizing all valid inference rules. Experiments on RocStories show that our method outperforms traditional models significantly.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language UnderstandingReading ComprehensionvalidSimilar Papers 제목 키워드 기반
Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension
Conventional Machine Reading Comprehension (MRC) has been well-addressed by pattern matching, but the ability of commonsense reasoning remains a gap between humans and machines. Previous methods tackle this problem by en…
Knowledge Graph EmbeddingsKnowledge GraphsMachine Reading ComprehensionReading ComprehensionMITRE at SemEval-2018 Task 11: Commonsense Reasoning without Commonsense Knowledge
This paper describes MITRE{'}s participation in SemEval-2018 Task 11: Machine Comprehension using Commonsense Knowledge. The techniques explored range from simple bag-of-ngrams classifiers to neural architectures with va…
Common Sense ReasoningInformation RetrievalReading ComprehensionregressionMCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledge
We introduce a large dataset of narrative texts and questions about these texts, intended to be used in a machine comprehension task that requires reasoning using commonsense knowledge. Our dataset complements similar da…
Natural Language UnderstandingReading ComprehensionReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehension
We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind hu…
Common Sense ReasoningMachine Reading ComprehensionReading ComprehensionIntegrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model
Despite the significant progress made by transformer models in machine reading comprehension tasks, they still fall short in handling complex reasoning tasks due to the absence of explicit knowledge in the input sequence…
Common Sense ReasoningGraph AttentionMachine Reading ComprehensionPosition+1