Measuring Semantic Coherence of a Conversation
Conversational systems have become increasingly popular as a way for humans to interact with computers. To be able to provide intelligent responses, conversational systems must correctly model the structure and semantics of a conversation. We introduce the task of measuring semantic (in)coherence in a conversation with respect to background knowledge, which relies on the identification of semantic relations between concepts introduced during a conversation. We propose and evaluate graph-based and machine learning-based approaches for measuring semantic coherence using knowledge graphs, their vector space embeddings and word embedding models, as sources of background knowledge. We demonstrate how these approaches are able to uncover different coherence patterns in conversations on the Ubuntu Dialogue Corpus.
Code (2)
Tasks
Knowledge GraphsSimilar Papers 제목 키워드 기반
CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
Recent advancements in zero-shot text-to-speech (TTS) modeling have led to significant strides in generating high-fidelity and diverse speech. However, dialogue generation, along with achieving human-like naturalness in …
Dialogue Generationtext-to-speechText to SpeechAutomated Speaking Assessment of Conversation Tests with Novel Graph-based Modeling on Spoken Response Coherence
Automated speaking assessment in conversation tests (ASAC) aims to evaluate the overall speaking proficiency of an L2 (second-language) speaker in a setting where an interlocutor interacts with one or more candidates. Al…
Amory: Building Coherent Narrative-Driven Agent Memory through Agentic Reasoning
Long-term conversational agents face a fundamental scalability challenge as interactions extend over time: repeatedly processing entire conversation histories becomes computationally prohibitive. Current approaches attem…
Answer-guided and Semantic Coherent Question Generation in Open-domain Conversation
Generating intriguing question is a key step towards building human-like open-domain chatbots. Although some recent works have focused on this task, compared with questions raised by humans, significant gaps remain in ma…
Question GenerationQuestion-GenerationReinforcement LearningCIG: Measuring Conversational Information Gain in Deliberative Dialogues with Semantic Memory Dynamics
Measuring the quality of public deliberation requires evaluating not only civility or argument structure, but also the informational progress of a conversation. We introduce a framework for Conversational Information Gai…