Fusing Context Into Knowledge Graph for Commonsense Question Answering
Commonsense question answering (QA) requires a model to grasp commonsense and factual knowledge to answer questions about world events. Many prior methods couple language modeling with knowledge graphs (KG). However, although a KG contains rich structural information, it lacks the context to provide a more precise understanding of the concepts. This creates a gap when fusing knowledge graphs into language modeling, especially when there is insufficient labeled data. Thus, we propose to employ external entity descriptions to provide contextual information for knowledge understanding. We retrieve descriptions of related concepts from Wiktionary and feed them as additional input to pre-trained language models. The resulting model achieves state-of-the-art result in the CommonsenseQA dataset and the best result among non-generative models in OpenBookQA.
Code (2)
Tasks
Common Sense ReasoningKnowledge GraphsLanguage ModelingLanguage ModellingQuestion AnsweringRelational ReasoningSimilar Papers 제목 키워드 기반
Text-based RL Agents with Commonsense Knowledge: New Challenges, Environments and Approaches
Text-based games have emerged as an important test-bed for Reinforcement Learning (RL) research, requiring RL agents to combine grounded language understanding with sequential decision making. In this paper, we examine t…
Decision MakingReinforcement Learning (RL)Sequential Decision Makingtext-based gamesKG-ViP: Bridging Knowledge Grounding and Visual Perception in Multi-modal LLMs for Visual Question Answering
Multi-modal Large Language Models (MLLMs) for Visual Question Answering (VQA) often suffer from dual limitations: knowledge hallucination and insufficient fine-grained visual perception. Crucially, we identify that commo…
Visual Question AnsweringJointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering
Existing KG-augmented models for commonsense question answering primarily focus on designing elaborate Graph Neural Networks (GNNs) to model knowledge graphs (KGs). However, they ignore (i) the effectively fusing and rea…
Knowledge GraphsQuestion AnsweringText-based RL Agents with Commonsense Knowledge: New Challenges, Environments and Baselines
Text-based games have emerged as an important test-bed for Reinforcement Learning (RL) research, requiring RL agents to combine grounded language understanding with sequential decision making. In this paper, we examine t…
Common Sense ReasoningCommonsense Reasoning for RLDecision MakingReinforcement Learning (RL)+2JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering
Existing KG-augmented models for question answering primarily focus on designing elaborate Graph Neural Networks (GNNs) to model knowledge graphs (KGs). However, they ignore (i) the effectively fusing and reasoning over …
Knowledge GraphsQuestion Answering