paper-with-me

홈 › Papers

S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMs

2023-09-16 · Sarkar Snigdha Sarathi Das, Chirag Shah, Mengting Wan, Jennifer Neville, Longqi Yang, Reid Andersen, Georg Buscher, Tara Safavi

The traditional Dialogue State Tracking (DST) problem aims to track user preferences and intents in user-agent conversations. While sufficient for task-oriented dialogue systems supporting narrow domain applications, the advent of Large Language Model (LLM)-based chat systems has introduced many real-world intricacies in open-domain dialogues. These intricacies manifest in the form of increased complexity in contextual interactions, extended dialogue sessions encompassing a diverse array of topics, and more frequent contextual shifts. To handle these intricacies arising from evolving LLM-based chat systems, we propose joint dialogue segmentation and state tracking per segment in open-domain dialogue systems. Assuming a zero-shot setting appropriate to a true open-domain dialogue system, we propose S3-DST, a structured prompting technique that harnesses Pre-Analytical Recollection, a novel grounding mechanism we designed for improving long context tracking. To demonstrate the efficacy of our proposed approach in joint segmentation and state tracking, we evaluate S3-DST on a proprietary anonymized open-domain dialogue dataset, as well as publicly available DST and segmentation datasets. Across all datasets and settings, S3-DST consistently outperforms the state-of-the-art, demonstrating its potency and robustness the next generation of LLM-based chat systems.

📄 PDF Abstract BibTeX arXiv:2309.08827

Code (0)

등록된 구현이 없습니다.

Tasks

Dialogue State TrackingLanguage ModellingLarge Language ModelSegmentationTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

Open-domain Dialogue Generation Grounded with Dynamic Multi-form Knowledge Fusion

2022-04-24 · Feifei Xu, Shanlin Zhou, Xinpeng Wang, Yunpu Ma 외

Open-domain multi-turn conversations normally face the challenges of how to enrich and expand the content of the conversation. Recently, many approaches based on external knowledge are proposed to generate rich semantic …

Dialogue GenerationFormInformativenessKnowledge Graphs

Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey

2024-11-14 · Longxuan Ma, Mingda Li, Weinan Zhang, Jiapeng Li 외

Incorporating external knowledge into dialogue generation has been proven to benefit the performance of an open-domain Dialogue System (DS), such as generating informative or stylized responses, controlling conversation …

Dialogue GenerationResponse GenerationRetrievalSurvey

Emphasising Structured Information: Integrating Abstract Meaning Representation into LLMs for Enhanced Open-Domain Dialogue Evaluation

2024-04-01 · Bohao Yang, Kun Zhao, Chen Tang, Dong Liu 외

Automatic open-domain dialogue evaluation has attracted increasing attention. Trainable evaluation metrics, typically trained with true positive and randomly selected negative responses, tend to assign higher scores to r…

Abstract Meaning RepresentationDialogue EvaluationIn-Context LearningRepresentation Learning

When F1 Fails: Granularity-Aware Evaluation for Dialogue Topic Segmentation

2025-12-18 · Michael H. Coen arxiv

Dialogue topic segmentation supports summarization, retrieval, memory management, and conversational continuity. Despite decades of work, evaluation practice remains dominated by strict boundary matching and F1-based met…

CTRLStruct: Dialogue Structure Learning for Open-Domain Response Generation

2023-03-02 · Congchi Yin, Piji Li, Zhaochun Ren

Dialogue structure discovery is essential in dialogue generation. Well-structured topic flow can leverage background information and predict future topics to help generate controllable and explainable responses. However,…

Contrastive LearningDialogue GenerationResponse GenerationSentence+2