Enhancing Multiple-Choice Question Answering with Causal Knowledge
The task of causal question answering aims to reason about causes and effects over a provided real or hypothetical premise. Recent approaches have converged on using transformer-based language models to solve question answering tasks. However, pretrained language models often struggle when external knowledge is not present in the premise or when additional context is required to answer the question. To the best of our knowledge, no prior work has explored the efficacy of augmenting pretrained language models with external causal knowledge for multiple-choice causal question answering. In this paper, we present novel strategies for the representation of causal knowledge. Our empirical results demonstrate the efficacy of augmenting pretrained models with external causal knowledge. We show improved performance on the COPA (Choice of Plausible Alternatives) and WIQA (What If Reasoning Over Procedural Text) benchmark tasks. On the WIQA benchmark, our approach is competitive with the state-of-the-art and exceeds it within the evaluation subcategories of In-Paragraph and Out-of-Paragraph perturbations.
Code (0)
등록된 구현이 없습니다.
Tasks
Multiple-choiceQuestion AnsweringSimilar Papers 제목 키워드 기반
Enhancing Event Causality Identification with Rationale and Structure-Aware Causal Question Answering
Document-level Event Causality Identification (DECI) aims to identify causal relations between two events in documents. Recent research tends to use pre-trained language models to generate the event causal relations. Whe…
Event Causality IdentificationMultiple-choiceMulti-Task LearningQuestion AnsweringFusionMind -- Improving question and answering with external context fusion
Answering questions using pre-trained language models (LMs) and knowledge graphs (KGs) presents challenges in identifying relevant knowledge and performing joint reasoning.We compared LMs (fine-tuned for the task) with t…
Knowledge GraphsMultiple-choiceQuestion AnsweringKARMA-MV: A Benchmark for Causal Question Answering on Music Videos
While significant progress has been made in Video Question Answering and cross-modal understanding, causal reasoning about how visual dynamics drive musical structure in music videos remains under-explored. We introduce …
Video Question AnsweringCNN for Text-Based Multiple Choice Question Answering
The task of Question Answering is at the very core of machine comprehension. In this paper, we propose a Convolutional Neural Network (CNN) model for text-based multiple choice question answering where questions are base…
Multiple-choiceQuestion AnsweringReading ComprehensionSentiment AnalysisLost in the Prompt Order: Revealing the Limitations of Causal Attention in Language Models
Large language models exhibit surprising sensitivity to the structure of the prompt, but the mechanisms underlying this sensitivity remain poorly understood. In this work, we conduct an in-depth investigation on a striki…
Question Answering