paper-with-me

홈 › Papers

Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering

2020-05-02 · Findings of the Association for Computational Linguistics 2020 · Peifeng Wang, Nanyun Peng, Filip Ilievski, Pedro Szekely, Xiang Ren

Commonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, relying entirely on these KGs may not suffice, considering their limited coverage and the contextual dependence of their knowledge. In this paper, we augment a general commonsense QA framework with a knowledgeable path generator. By extrapolating over existing paths in a KG with a state-of-the-art language model, our generator learns to connect a pair of entities in text with a dynamic, and potentially novel, multi-hop relational path. Such paths can provide structured evidence for solving commonsense questions without fine-tuning the path generator. Experiments on two datasets show the superiority of our method over previous works which fully rely on knowledge from KGs (with up to 6% improvement in accuracy), across various amounts of training data. Further evaluation suggests that the generated paths are typically interpretable, novel, and relevant to the task.

📄 PDF Abstract BibTeX arXiv:2005.00691

Code (1)

wangpf3/Commonsense-Path-Generator 공식 구현 pytorch

Tasks

Knowledge GraphsLanguage ModelingLanguage ModellingQuestion Answering

Similar Papers 제목 키워드 기반

ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models

2023-03-29 · Ning Bian, Xianpei Han, Le Sun, Hongyu Lin 외

Large language models (LLMs) have made significant progress in NLP. However, their ability to memorize, represent, and leverage commonsense knowledge has been a well-known pain point. In this paper, we specifically focus…

Instruction Following

Improving Response Diversity through Commonsense-Aware Empathetic Response Generation

2022-11-01 · ROCLING 2022 11 · Tzu-Hsien Huang, Chia-Hui Chang

Due to the lack of conversation practice, the main challenge for the second-language learners is speaking. Our goal is to develop a chatbot to encourage individuals to reflect, describe, analyse and communicate what they…

ChatbotDiversityEmpathetic Response GenerationResponse Generation

Reconstructing Implicit Knowledge with Language Models

2021-06-01 · NAACL (DeeLIO) 2021 6 · Maria Becker, Siting Liang, Anette Frank

In this work we propose an approach for generating statements that explicate implicit knowledge connecting sentences in text. We make use of pre-trained language models which we refine by fine-tuning them on specifically…

Sentence

CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning

2023-05-08 · Weiqi Wang, Tianqing Fang, Baixuan Xu, Chun Yi Louis Bo 외

Commonsense reasoning, aiming at endowing machines with a human-like ability to make situational presumptions, is extremely challenging to generalize. For someone who barely knows about "meditation," while is knowledgeab…

Connecting the Dots: Event Graph Schema Induction with Path Language Modeling

2020-11-01 · EMNLP 2020 11 · Manling Li, Qi Zeng, Ying Lin, Kyunghyun Cho 외

Event schemas can guide our understanding and ability to make predictions with respect to what might happen next. We propose a new Event Graph Schema, where two event types are connected through multiple paths involving …

Language ModelingLanguage Modelling