paper-with-me

홈 › Papers

ConvoSense: Overcoming Monotonous Commonsense Inferences for Conversational AI

2024-01-27 · Sarah E. Finch, Jinho D. Choi

Mastering commonsense understanding and reasoning is a pivotal skill essential for conducting engaging conversations. While there have been several attempts to create datasets that facilitate commonsense inferences in dialogue contexts, existing datasets tend to lack in-depth details, restate information already present in the conversation, and often fail to capture the multifaceted nature of commonsense reasoning. In response to these limitations, we compile a new synthetic dataset for commonsense reasoning in dialogue contexts using GPT, ConvoSense, that boasts greater contextual novelty, offers a higher volume of inferences per example, and substantially enriches the detail conveyed by the inferences. Our dataset contains over 500,000 inferences across 12,000 dialogues with 10 popular inference types, which empowers the training of generative commonsense models for dialogue that are superior in producing plausible inferences with high novelty when compared to models trained on the previous datasets. To the best of our knowledge, ConvoSense is the first of its kind to provide such a multitude of novel inferences at such a large scale.

📄 PDF Abstract BibTeX arXiv:2401.15471

Code (1)

emorynlp/convosense 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Weight Decay 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

Paragraph-level Commonsense Transformers with Recurrent Memory

2020-10-04 · Saadia Gabriel, Chandra Bhagavatula, Vered Shwartz, Ronan Le Bras 외

Human understanding of narrative texts requires making commonsense inferences beyond what is stated explicitly in the text. A recent model, COMET, can generate such implicit commonsense inferences along several dimension…

SentenceWorld Knowledge

DIVE: Towards Descriptive and Diverse Visual Commonsense Generation

2024-08-15 · Jun-Hyung Park, Hyuntae Park, Youjin Kang, Eojin Jeon 외

Towards human-level visual understanding, visual commonsense generation has been introduced to generate commonsense inferences beyond images. However, current research on visual commonsense generation has overlooked an i…

DescriptiveDiversity

Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization

2022-09-02 · COLING 2022 10 · Seungone Kim, Se June Joo, Hyungjoo Chae, Chaehyeong Kim 외

In this paper, we propose to leverage the unique characteristics of dialogues sharing commonsense knowledge across participants, to resolve the difficulties in summarizing them. We present SICK, a framework that uses com…

Abstractive Dialogue SummarizationMulti-Task LearningText Summarization

Bridging the Gap between Recognition-level Pre-training and Commonsensical Vision-language Tasks

2022-05-01 · CSRR (ACL) 2022 5 · Yue Wan, Yueen Ma, Haoxuan You, Zhecan Wang 외

Large-scale visual-linguistic pre-training aims to capture the generic representations from multimodal features, which are essential for downstream vision-language tasks. Existing methods mostly focus on learning the sem…

DiversityInformativenessType predictionVisual Question Answering (VQA)

COMET-M: Reasoning about Multiple Events in Complex Sentences

2023-05-24 · Sahithya Ravi, Raymond Ng, Vered Shwartz

Understanding the speaker's intended meaning often involves drawing commonsense inferences to reason about what is not stated explicitly. In multi-event sentences, it requires understanding the relationships between even…

coreference-resolutionCoreference ResolutionSentence