FusionMind -- Improving question and answering with external context fusion
Answering questions using pre-trained language models (LMs) and knowledge graphs (KGs) presents challenges in identifying relevant knowledge and performing joint reasoning.We compared LMs (fine-tuned for the task) with the previously published QAGNN method for the Question-answering (QA) objective and further measured the impact of additional factual context on the QAGNN performance. The QAGNN method employs LMs to encode QA context and estimate KG node importance, and effectively update the question choice entity representations using Graph Neural Networks (GNNs). We further experimented with enhancing the QA context encoding by incorporating relevant knowledge facts for the question stem. The models are trained on the OpenbookQA dataset, which contains ~6000 4-way multiple choice questions and is widely used as a benchmark for QA tasks. Through our experimentation, we found that incorporating knowledge facts context led to a significant improvement in performance. In contrast, the addition of knowledge graphs to language models resulted in only a modest increase. This suggests that the integration of contextual knowledge facts may be more impactful for enhancing question answering performance compared to solely adding knowledge graphs.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsMultiple-choiceQuestion AnsweringSimilar Papers 제목 키워드 기반
Knowledge Fusion and Semantic Knowledge Ranking for Open Domain Question Answering
Open Domain Question Answering requires systems to retrieve external knowledge and perform multi-hop reasoning by composing knowledge spread over multiple sentences. In the recently introduced open domain question answer…
Information RetrievalOpen-Domain Question AnsweringQuestion AnsweringRetrievalContext Quality Matters in Training Fusion-in-Decoder for Extractive Open-Domain Question Answering
Retrieval-augmented generation models augment knowledge encoded in a language model by providing additional relevant external knowledge (context) during generation. Although it has been shown that the quantity and qualit…
DecoderLanguage ModelingLanguage ModellingOpen-Domain Question Answering+3How Should LLMs Listen While Speaking? A Study of User-Stream Routing in Full-Duplex Spoken Dialogue
Full-duplex spoken dialogue requires a model to keep listening while generating its own spoken response. This is challenging for large language models (LLMs), which are designed to extend a single coherent sequence and d…
Question AnsweringContext Generation Improves Open Domain Question Answering
Closed-book question answering (QA) requires a model to directly answer an open-domain question without access to any external knowledge. Prior work on closed-book QA either directly finetunes or prompts a pretrained lan…
Language ModelingLanguage ModellingOpen-Domain Question AnsweringQuestion AnsweringEnhancing Multiple-Choice Question Answering with Causal Knowledge
The task of causal question answering aims to reason about causes and effects over a provided real or hypothetical premise. Recent approaches have converged on using transformer-based language models to solve question an…
Multiple-choiceQuestion Answering