Multi-Relational Question Answering from Narratives: Machine Reading and Reasoning in Simulated Worlds
Question Answering (QA), as a research field, has primarily focused on either knowledge bases (KBs) or free text as a source of knowledge. These two sources have historically shaped the kinds of questions that are asked over these sources, and the methods developed to answer them. In this work, we look towards a practical use-case of QA over user-instructed knowledge that uniquely combines elements of both structured QA over knowledge bases, and unstructured QA over narrative, introducing the task of multi-relational QA over personal narrative. As a first step towards this goal, we make three key contributions: (i) we generate and release TextWorldsQA, a set of five diverse datasets, where each dataset contains dynamic narrative that describes entities and relations in a simulated world, paired with variably compositional questions over that knowledge, (ii) we perform a thorough evaluation and analysis of several state-of-the-art QA models and their variants at this task, and (iii) we release a lightweight Python-based framework we call TextWorlds for easily generating arbitrary additional worlds and narrative, with the goal of allowing the community to create and share a growing collection of diverse worlds as a test-bed for this task.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringReading ComprehensionSimilar Papers 제목 키워드 기반
TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering
Multi-hop Knowledge Graph Question Answering (KGQA) requires coherent reasoning across relational paths, yet existing methods often treat each reasoning step independently and fail to effectively leverage experience from…
Graph Question AnsweringPath-Enhanced Multi-Relational Question Answering with Knowledge Graph Embeddings
The multi-relational Knowledge Base Question Answering (KBQA) system performs multi-hop reasoning over the knowledge graph (KG) to achieve the answer. Recent approaches attempt to introduce the knowledge graph embedding …
Graph EmbeddingKnowledge Base Question AnsweringKnowledge Graph EmbeddingKnowledge Graph Embeddings+1Chart Question Answering from Real-World Analytical Narratives
We present a new dataset for chart question answering (CQA) constructed from visualization notebooks. The dataset features real-world, multi-view charts paired with natural language questions grounded in analytical narra…
Chart Question AnsweringGraph-Based Knowledge Integration for Question Answering over Dialogue
Question answering over dialogue, a specialized machine reading comprehension task, aims to comprehend a dialogue and to answer specific questions. Despite many advances, existing approaches for this task did not conside…
Machine Reading ComprehensionQuestion AnsweringReading ComprehensionRelational ReasoningARN: Analogical Reasoning on Narratives
As a core cognitive skill that enables the transferability of information across domains, analogical reasoning has been extensively studied for both humans and computational models. However, while cognitive theories of a…