paper-with-me

홈 › Papers

Reverse Multi-Choice Dialogue Commonsense Inference with Graph-of-Thought

2023-12-23 · Li Zheng, Hao Fei, Fei Li, Bobo Li, Lizi Liao, Donghong Ji, Chong Teng

With the proliferation of dialogic data across the Internet, the Dialogue Commonsense Multi-choice Question Answering (DC-MCQ) task has emerged as a response to the challenge of comprehending user queries and intentions. Although prevailing methodologies exhibit effectiveness in addressing single-choice questions, they encounter difficulties in handling multi-choice queries due to the heightened intricacy and informational density. In this paper, inspired by the human cognitive process of progressively excluding options, we propose a three-step Reverse Exclusion Graph-of-Thought (ReX-GoT) framework, including Option Exclusion, Error Analysis, and Combine Information. Specifically, our ReX-GoT mimics human reasoning by gradually excluding irrelevant options and learning the reasons for option errors to choose the optimal path of the GoT and ultimately infer the correct answer. By progressively integrating intricate clues, our method effectively reduces the difficulty of multi-choice reasoning and provides a novel solution for DC-MCQ. Extensive experiments on the CICERO and CICERO$_{v2}$ datasets validate the significant improvement of our approach on DC-MCQ task. On zero-shot setting, our model outperform the best baseline by 17.67% in terms of F1 score for the multi-choice task. Most strikingly, our GPT3.5-based ReX-GoT framework achieves a remarkable 39.44% increase in F1 score.

📄 PDF Abstract BibTeX arXiv:2312.15291

Code (1)

zhengl00/rex-got 공식 구현 pytorch

Tasks

Question Answering

Similar Papers 제목 키워드 기반

CIDER: Commonsense Inference for Dialogue Explanation and Reasoning

2021-06-01 · SIGDIAL (ACL) 2021 7 · Deepanway Ghosal, Pengfei Hong, Siqi Shen, Navonil Majumder 외

Commonsense inference to understand and explain human language is a fundamental research problem in natural language processing. Explaining human conversations poses a great challenge as it requires contextual understand…

Natural Language Inference

Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization

2022-09-02 · COLING 2022 10 · Seungone Kim, Se June Joo, Hyungjoo Chae, Chaehyeong Kim 외

In this paper, we propose to leverage the unique characteristics of dialogues sharing commonsense knowledge across participants, to resolve the difficulties in summarizing them. We present SICK, a framework that uses com…

Abstractive Dialogue SummarizationMulti-Task LearningText Summarization

ConvoSense: Overcoming Monotonous Commonsense Inferences for Conversational AI

2024-01-27 · Sarah E. Finch, Jinho D. Choi

Mastering commonsense understanding and reasoning is a pivotal skill essential for conducting engaging conversations. While there have been several attempts to create datasets that facilitate commonsense inferences in di…

CultureTalk-ID: A Multi-Task Dialogue Benchmark for Cultural Commonsense in Indonesian Local Languages

2026-07-23 · Muhammad Dehan Al Kautsar, Salsabila Pranida, Bilal Elbouardi, Fajri Koto arxiv

Culture is lived through conversation, yet existing Indonesian cultural commonsense benchmarks evaluate LLMs on short and isolated prompts, stripping away the dialogic context in which cultural nuances actually surface. …

Machine Translation

Multiview Contextual Commonsense Inference: A New Dataset and Task

2022-10-06 · Siqi Shen, Deepanway Ghosal, Navonil Majumder, Henry Lim 외

Contextual commonsense inference is the task of generating various types of explanations around the events in a dyadic dialogue, including cause, motivation, emotional reaction, and others. Producing a coherent and non-t…

Multiview Contextual Commonsense Inference