paper-with-me

홈 › Papers

ChatGPT for Zero-shot Dialogue State Tracking: A Solution or an Opportunity?

2023-06-02 · Michael Heck, Nurul Lubis, Benjamin Ruppik, Renato Vukovic, Shutong Feng, Christian Geishauser, Hsien-Chin Lin, Carel van Niekerk, Milica Gašić

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger language model based architectures. In contrast, general purpose language models, trained on large amounts of diverse data, hold the promise of solving any kind of task without task-specific training. We present preliminary experimental results on the ChatGPT research preview, showing that ChatGPT achieves state-of-the-art performance in zero-shot DST. Despite our findings, we argue that properties inherent to general purpose models limit their ability to replace specialized systems. We further theorize that the in-context learning capabilities of such models will likely become powerful tools to support the development of dedicated and dynamic dialogue state trackers.

📄 PDF Abstract BibTeX arXiv:2306.01386

Code (1)

budzianowski/multiwoz 공식 구현 pytorch

Tasks

Data AugmentationDialogue State TrackingIn-Context LearningLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

A Preliminary Evaluation of ChatGPT for Zero-shot Dialogue Understanding

2023-04-09 · Wenbo Pan, Qiguang Chen, Xiao Xu, Wanxiang Che 외

Zero-shot dialogue understanding aims to enable dialogue to track the user's needs without any training data, which has gained increasing attention. In this work, we investigate the understanding ability of ChatGPT for z…

Dialogue State TrackingDialogue Understandingslot-fillingSlot Filling+1

Towards LLM-driven Dialogue State Tracking

2023-10-23 · Yujie Feng, Zexin Lu, Bo Liu, LiMing Zhan 외

Dialogue State Tracking (DST) is of paramount importance in ensuring accurate tracking of user goals and system actions within task-oriented dialogue systems. The emergence of large language models (LLMs) such as GPT3 an…

Dialogue State TrackingTask-Oriented Dialogue Systems

Large Language Models as Zero-shot Dialogue State Tracker through Function Calling

2024-02-16 · Zekun Li, Zhiyu Zoey Chen, Mike Ross, Patrick Huber 외

Large language models (LLMs) are increasingly prevalent in conversational systems due to their advanced understanding and generative capabilities in general contexts. However, their effectiveness in task-oriented dialogu…

AvgDialogue State TrackingResponse Generation

Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Tracking

2020-05-02 · ACL 2020 6 · Giovanni Campagna, Agata Foryciarz, Mehrad Moradshahi, Monica S. Lam

Zero-shot transfer learning for multi-domain dialogue state tracking can allow us to handle new domains without incurring the high cost of data acquisition. This paper proposes new zero-short transfer learning technique …

Data AugmentationDialogue State TrackingMulti-domain Dialogue State TrackingTransfer Learning+1

Choice Fusion as Knowledge for Zero-Shot Dialogue State Tracking

2023-02-25 · Ruolin Su, Jingfeng Yang, Ting-Wei Wu, Biing-Hwang Juang

With the demanding need for deploying dialogue systems in new domains with less cost, zero-shot dialogue state tracking (DST), which tracks user's requirements in task-oriented dialogues without training on desired domai…

DecoderDialogue State TrackingLanguage ModelingLanguage Modelling+2