Diverse and Effective Synthetic Data Generation for Adaptable Zero-Shot Dialogue State Tracking
We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains and slot types they cover due to the high costs of data collection, restricting their adaptability to new domains. This work addresses this challenge with a novel, fully automatic data generation approach that creates synthetic zero-shot DST datasets. Distinguished from previous methods, our approach can generate dialogues across a massive range of application domains, complete with silver-standard dialogue state annotations and slot descriptions. This technique is used to create the D0T dataset for training zero-shot DST models, encompassing an unprecedented 1,000+ domains. Experiments on the MultiWOZ benchmark show that training models on diverse synthetic data improves Joint Goal Accuracy by 6.7%, achieving results competitive with models 13.5 times larger than ours.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue State TrackingDiversitySynthetic Data GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Framework for Synthetic Audio Conversations Generation using Large Language Models
In this paper, we introduce ConversaSynth, a framework designed to generate synthetic conversation audio using large language models (LLMs) with multiple persona settings. The framework first creates diverse and coherent…
Audio ClassificationAudio TaggingDiversityspeech-recognition+3Scalable Modular Synthetic Data Generation for Advancing Aerial Autonomy
One major barrier to advancing aerial autonomy has been collecting large-scale aerial datasets for training machine learning models. Due to costly and time-consuming real-world data collection through deploying drones, t…
Data AugmentationSynthetic Data GenerationAnySynth: Harnessing the Power of Image Synthetic Data Generation for Generalized Vision-Language Tasks
Diffusion models have recently been employed to generate high-quality images, reducing the need for manual data collection and improving model generalization in tasks such as object detection, instance segmentation, and …
Few-Shot Object DetectionImage GenerationImage RetrievalInstance Segmentation+5A Synthetic Over-sampling method with Minority and Majority classes for imbalance problems
Class imbalance is a substantial challenge in classifying many real-world cases. Synthetic over-sampling methods have been effective to improve the performance of classifiers for imbalance problems. However, most synthet…
ForgetMe: Evaluating Selective Forgetting in Generative Models
The widespread adoption of diffusion models in image generation has increased the demand for privacy-compliant unlearning. However, due to the high-dimensional nature and complex feature representations of diffusion mode…
Image GenerationPrivacy Preserving