paper-with-me

홈 › Papers

Multiview Contextual Commonsense Inference: A New Dataset and Task

2022-10-06 · Siqi Shen, Deepanway Ghosal, Navonil Majumder, Henry Lim, Rada Mihalcea, Soujanya Poria

Contextual commonsense inference is the task of generating various types of explanations around the events in a dyadic dialogue, including cause, motivation, emotional reaction, and others. Producing a coherent and non-trivial explanation requires awareness of the dialogue's structure and of how an event is grounded in the context. In this work, we create CICEROv2, a dataset consisting of 8,351 instances from 2,379 dialogues, containing multiple human-written answers for each contextual commonsense inference question, representing a type of explanation on cause, subsequent event, motivation, and emotional reaction. We show that the inferences in CICEROv2 are more semantically diverse than other contextual commonsense inference datasets. To solve the inference task, we propose a collection of pre-training objectives, including concept denoising and utterance sorting to prepare a pre-trained model for the downstream contextual commonsense inference task. Our results show that the proposed pre-training objectives are effective at adapting the pre-trained T5-Large model for the contextual commonsense inference task.

📄 PDF Abstract BibTeX arXiv:2210.02890

Code (1)

declare-lab/CICERO 공식 구현

Tasks

Multiview Contextual Commonsense Inference

Similar Papers 제목 키워드 기반

Can Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference

2024-10-03 · Pedro Colon-Hernandez, Nanxi Liu, Chelsea Joe, Peter Chin 외

Generating commonsense assertions within a given story context remains a difficult task for modern language models. Previous research has addressed this problem by aligning commonsense inferences with stories and trainin…

Data AugmentationText Generation

CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues

2022-03-25 · ACL 2022 5 · Deepanway Ghosal, Siqi Shen, Navonil Majumder, Rada Mihalcea 외

This paper addresses the problem of dialogue reasoning with contextualized commonsense inference. We curate CICERO, a dataset of dyadic conversations with five types of utterance-level reasoning-based inferences: cause, …

Answer GenerationAnswer Selection

CoSe-Co: Sentence Conditioned Generative CommonSense Contextualizer for Language Models

2021-09-03 · AKBC Workshop CSKB 2021 10 · Rachit Bansal, Milan Aggarwal, Sumit Bhatia, Jivat Neet Kaur 외

Pre-trained Language Models (PTLMs) have been shown to perform well on natural language reasoning tasks requiring commonsense. Prior work has leveraged structured commonsense present in knowledge graphs (KGs) to assist P…

ARCKnowledge GraphsNovel ConceptsSentence

Adversarial Transformer Language Models for Contextual Commonsense Inference

2023-02-10 · Pedro Colon-Hernandez, Henry Lieberman, Yida Xin, Claire Yin 외

Contextualized or discourse aware commonsense inference is the task of generating coherent commonsense assertions (i.e., facts) from a given story, and a particular sentence from that story. Some problems with the task a…

Knowledge GraphsLanguage ModelingLanguage ModellingSentence

CIDER: Commonsense Inference for Dialogue Explanation and Reasoning

2021-06-01 · SIGDIAL (ACL) 2021 7 · Deepanway Ghosal, Pengfei Hong, Siqi Shen, Navonil Majumder 외

Commonsense inference to understand and explain human language is a fundamental research problem in natural language processing. Explaining human conversations poses a great challenge as it requires contextual understand…

Natural Language Inference