paper-with-me

Papers

Relation-aware Bidirectional Path Reasoning for Commonsense Question Answering

2021-11-01 · CoNLL (EMNLP) 2021 11 · Junxing Wang, Xinyi Li, Zhen Tan, Xiang Zhao, Weidong Xiao

Commonsense Question Answering is an important natural language processing (NLP) task that aims to predict the correct answer to a question through commonsense reasoning. Previous studies utilize pre-trained models on large-scale corpora such as BERT, or perform reasoning on knowledge graphs. However, these methods do not explicitly model the relations that connect entities, which are informational and can be used to enhance reasoning. To address this issue, we propose a relation-aware reasoning method. Our method uses a relation-aware graph neural network to capture the rich contextual information from both entities and relations. Compared with methods that use fixed relation embeddings from pre-trained models, our model dynamically updates relations with contextual information from a multi-source subgraph, built from multiple external knowledge sources. The enhanced representations of relations are then fed to a bidirectional reasoning module. A bidirectional attention mechanism is applied between the question sequence and the paths that connect entities, which provides us with transparent interpretability. Experimental results on the CommonsenseQA dataset illustrate that our method results in significant improvements over the baselines while also providing clear reasoning paths.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkKnowledge GraphsQuestion AnsweringRelation

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph

2020-09-24 · EMNLP 2020 11 · Haozhe Ji, Pei Ke, Shaohan Huang, Furu Wei 외

Despite the success of generative pre-trained language models on a series of text generation tasks, they still suffer in cases where reasoning over underlying commonsense knowledge is required during generation. Existing…

Text Generation

CORN: Co-Reasoning Network for Commonsense Question Answering

2022-10-01 · COLING 2022 10 · Xin Guan, Biwei Cao, Qingqing Gao, Zheng Yin 외

Commonsense question answering (QA) requires machines to utilize the QA content and external commonsense knowledge graph (KG) for reasoning when answering questions. Existing work uses two independent modules to model th…

Question Answering

$Great~Truths~are ~Always ~Simple:$ A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Commonsense reasoning in natural language is a desired capacity of artificial intelligent systems. For solving complex commonsense reasoning tasks, a typical approach is to enhance pre-trained language models~(PTM) by a …

Graph Neural NetworkKnowledge GraphsRelation

Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models

2022-05-04 · Jinhao Jiang, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen

Commonsense reasoning in natural language is a desired ability of artificial intelligent systems. For solving complex commonsense reasoning tasks, a typical solution is to enhance pre-trained language models~(PTMs) with …

Graph Neural NetworkRelation

Great~Truths~are ~Always ~Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models

2022-07-01 · Findings (NAACL) 2022 7 · Jinhao Jiang, Kun Zhou, Ji-Rong Wen, Xin Zhao

Commonsense reasoning in natural language is a desired ability of artificial intelligent systems. For solving complex commonsense reasoning tasks, a typical solution is to enhance pre-trained language models (PTMs) with …

Graph Neural NetworkRelation