paper-with-me

홈 › Papers

In-Context Learning for Few-Shot Dialogue State Tracking

2022-03-16 · Yushi Hu, Chia-Hsuan Lee, Tianbao Xie, Tao Yu, Noah A. Smith, Mari Ostendorf

Collecting and annotating task-oriented dialogues is time-consuming and costly; thus, zero and few shot learning could greatly benefit dialogue state tracking (DST). In this work, we propose an in-context learning (ICL) framework for zero-shot and few-shot learning DST, where a large pre-trained language model (LM) takes a test instance and a few exemplars as input, and directly decodes the dialogue state without any parameter updates. To better leverage a tabular domain description in the LM prompt, we reformulate DST into a text-to-SQL problem. We also propose a novel approach to retrieve annotated dialogues as exemplars. Empirical results on MultiWOZ show that our method IC-DST substantially outperforms previous fine-tuned state-of-the-art models in few-shot settings. In addition, we test IC-DST in zero-shot settings, in which the model only takes a fixed task instruction as input, finding that it outperforms previous zero-shot methods by a large margin.

📄 PDF Abstract BibTeX arXiv:2203.08568

Code (1)

yushi-hu/ic-dst 공식 구현 pytorch

Tasks

Dialogue State TrackingFew-Shot LearningIn-Context LearningLanguage ModelingLanguage ModellingText to SQLText-To-SQL

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

Comprehensive Study: How the Context Information of Different Granularity Affects Dialogue State Tracking?

2021-05-08 · ACL 2021 5 · Puhai Yang, Heyan Huang, Xian-Ling Mao

Dialogue state tracking (DST) plays a key role in task-oriented dialogue systems to monitor the user's goal. In general, there are two strategies to track a dialogue state: predicting it from scratch and updating it from…

Dialogue State TrackingFew-Shot LearningTask-Oriented Dialogue Systems

Choice Fusion as Knowledge for Zero-Shot Dialogue State Tracking

2023-02-25 · Ruolin Su, Jingfeng Yang, Ting-Wei Wu, Biing-Hwang Juang

With the demanding need for deploying dialogue systems in new domains with less cost, zero-shot dialogue state tracking (DST), which tracks user's requirements in task-oriented dialogues without training on desired domai…

DecoderDialogue State TrackingLanguage ModelingLanguage Modelling+2

Intent-driven In-context Learning for Few-shot Dialogue State Tracking

2024-12-04 · Zihao Yi, Zhe Xu, Ying Shen

Dialogue state tracking (DST) plays an essential role in task-oriented dialogue systems. However, user's input may contain implicit information, posing significant challenges for DST tasks. Additionally, DST data include…

Dialogue State TrackingIn-Context LearningLanguage ModelingLanguage Modelling+2

Diverse Retrieval-Augmented In-Context Learning for Dialogue State Tracking

2023-07-04 · Brendan King, Jeffrey Flanigan

There has been significant interest in zero and few-shot learning for dialogue state tracking (DST) due to the high cost of collecting and annotating task-oriented dialogues. Recent work has demonstrated that in-context …

Dialogue State TrackingFew-Shot LearningIn-Context LearningRetrieval

Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Tracking

2021-05-10 · Zhaojiang Lin, Bing Liu, Seungwhan Moon, Paul Crook 외

Zero-shot cross-domain dialogue state tracking (DST) enables us to handle task-oriented dialogue in unseen domains without the expense of collecting in-domain data. In this paper, we propose a slot description enhanced g…

Dialogue State TrackingTransfer Learning