More Robust Schema-Guided Dialogue State Tracking via Tree-Based Paraphrase Ranking
The schema-guided paradigm overcomes scalability issues inherent in building task-oriented dialogue (TOD) agents with static ontologies. Instead of operating on dialogue context alone, agents have access to hierarchical schemas containing task-relevant natural language descriptions. Fine-tuned language models excel at schema-guided dialogue state tracking (DST) but are sensitive to the writing style of the schemas. We explore methods for improving the robustness of DST models. We propose a framework for generating synthetic schemas which uses tree-based ranking to jointly optimise lexical diversity and semantic faithfulness. The generalisation of strong baselines is improved when augmenting their training data with prompts generated by our framework, as demonstrated by marked improvements in average joint goal accuracy (JGA) and schema sensitivity (SS) on the SGD-X benchmark.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue State TrackingDiversityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
The SPPD System for Schema Guided Dialogue State Tracking Challenge
This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8), the SPPD system for Schema Guided dialogue state tracking challenge. This challenge, named as Track 4 in DSTC8, provides…
Dialogue State TrackingMulti-domain Dialogue State TrackingSGD-QA: Fast Schema-Guided Dialogue State Tracking for Unseen Services
Dialogue state tracking is an essential part of goal-oriented dialogue systems, while most of these state tracking models often fail to handle unseen services. In this paper, we propose SGD-QA, a simple and extensible mo…
Dialogue State TrackingGoal-Oriented Dialogue SystemsQuestion AnsweringSpan-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Tracking
In schema-guided dialogue state tracking models estimate the current state of a conversation using natural language descriptions of the service schema for generalization to unseen services. Prior generative approaches wh…
Dialogue State TrackingSchema-Guided Multi-Domain Dialogue State Tracking with Graph Attention Neural Networks
Dialogue state tracking (DST) aims at estimating the current dialogue state given all the preceding conversation. For multi-domain DST, the data sparsity problem is also a major obstacle due to the increased number of st…
Dialogue State TrackingGraph AttentionMulti-domain Dialogue State TrackingSchema Graph-Guided Prompt for Multi-Domain Dialogue State Tracking
Tracking dialogue states is an essential topic in task-oriented dialogue systems, which involve filling in the necessary information in pre-defined slots corresponding to a schema. While general pre-trained language mode…
Dialogue State TrackingGraph Neural NetworkLanguage ModelingLanguage Modelling+4