paper-with-me

홈 › Papers

DiffuCOMET: Contextual Commonsense Knowledge Diffusion

2024-02-26 · Silin Gao, Mete Ismayilzada, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut

Inferring contextually-relevant and diverse commonsense to understand narratives remains challenging for knowledge models. In this work, we develop a series of knowledge models, DiffuCOMET, that leverage diffusion to learn to reconstruct the implicit semantic connections between narrative contexts and relevant commonsense knowledge. Across multiple diffusion steps, our method progressively refines a representation of commonsense facts that is anchored to a narrative, producing contextually-relevant and diverse commonsense inferences for an input context. To evaluate DiffuCOMET, we introduce new metrics for commonsense inference that more closely measure knowledge diversity and contextual relevance. Our results on two different benchmarks, ComFact and WebNLG+, show that knowledge generated by DiffuCOMET achieves a better trade-off between commonsense diversity, contextual relevance and alignment to known gold references, compared to baseline knowledge models.

📄 PDF Abstract BibTeX arXiv:2402.17011

Code (1)

silin159/diffucomet 공식 구현 pytorch

Tasks

Diversity

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge

2022-10-24 · Sahithya Ravi, Aditya Chinchure, Leonid Sigal, Renjie Liao 외

There has been a growing interest in solving Visual Question Answering (VQA) tasks that require the model to reason beyond the content present in the image. In this work, we focus on questions that require commonsense re…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Adversarial Transformer Language Models for Contextual Commonsense Inference

2023-02-10 · Pedro Colon-Hernandez, Henry Lieberman, Yida Xin, Claire Yin 외

Contextualized or discourse aware commonsense inference is the task of generating coherent commonsense assertions (i.e., facts) from a given story, and a particular sentence from that story. Some problems with the task a…

Knowledge GraphsLanguage ModelingLanguage ModellingSentence

Dynamic Neuro-Symbolic Knowledge Graph Construction for Zero-shot Commonsense Question Answering

2019-11-10 · Antoine Bosselut, Ronan Le Bras, Yejin Choi

Understanding narratives requires reasoning about implicit world knowledge related to the causes, effects, and states of situations described in text. At the core of this challenge is how to access contextually relevant …

graph constructionKnowledge GraphsQuestion AnsweringRetrieval+1

Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representations

2019-10-02 · WS 2019 11 · Jeff Da, Jungo Kasai

Pretrained deep contextual representations have advanced the state-of-the-art on various commonsense NLP tasks, but we lack a concrete understanding of the capability of these models. Thus, we investigate and challenge s…

Knowledge Graphs

ComFact: A Benchmark for Linking Contextual Commonsense Knowledge

2022-10-23 · Silin Gao, Jena D. Hwang, Saya Kanno, Hiromi Wakaki 외

Understanding rich narratives, such as dialogues and stories, often requires natural language processing systems to access relevant knowledge from commonsense knowledge graphs. However, these systems typically retrieve f…

Knowledge GraphsResponse GenerationRetrieval