A Comparative Study on Schema-Guided Dialogue State Tracking
Frame-based state representation is widely used in modern task-oriented dialog systems to model user intentions and slot values. However, a fixed design of domain ontology makes it difficult to extend to new services and APIs. Recent work proposed to use natural language descriptions to define the domain ontology instead of tag names for each intent or slot, thus offering a dynamic set of schema. In this paper, we conduct in-depth comparative studies to understand the use of natural language description for schema in dialog state tracking. Our discussion mainly covers three aspects: encoder architectures, impact of supplementary training, and effective schema description styles. We introduce a set of newly designed bench-marking descriptions and reveal the model robustness on both homogeneous and heterogeneous description styles in training and evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
dialog state trackingDialogue State TrackingTAGSimilar Papers 제목 키워드 기반
More Robust Schema-Guided Dialogue State Tracking via Tree-Based Paraphrase Ranking
The schema-guided paradigm overcomes scalability issues inherent in building task-oriented dialogue (TOD) agents with static ontologies. Instead of operating on dialogue context alone, agents have access to hierarchical …
Dialogue State TrackingDiversitySchema Graph-Guided Prompt for Multi-Domain Dialogue State Tracking
Tracking dialogue states is an essential topic in task-oriented dialogue systems, which involve filling in the necessary information in pre-defined slots corresponding to a schema. While general pre-trained language mode…
Dialogue State TrackingGraph Neural NetworkLanguage ModelingLanguage Modelling+4SGD-QA: Fast Schema-Guided Dialogue State Tracking for Unseen Services
Dialogue state tracking is an essential part of goal-oriented dialogue systems, while most of these state tracking models often fail to handle unseen services. In this paper, we propose SGD-QA, a simple and extensible mo…
Dialogue State TrackingGoal-Oriented Dialogue SystemsQuestion AnsweringSGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems
Zero/few-shot transfer to unseen services is a critical challenge in task-oriented dialogue research. The Schema-Guided Dialogue (SGD) dataset introduced a paradigm for enabling models to support any service in zero-shot…
Data AugmentationDialogue State TrackingShow, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue
Building universal dialogue systems that operate across multiple domains/APIs and generalize to new ones with minimal overhead is a critical challenge. Recent works have leveraged natural language descriptions of schema …
Dialogue State TrackingZero-shot Generalization