paper-with-me

홈 › Papers

Choice Fusion as Knowledge for Zero-Shot Dialogue State Tracking

2023-02-25 · Ruolin Su, Jingfeng Yang, Ting-Wei Wu, Biing-Hwang Juang

With the demanding need for deploying dialogue systems in new domains with less cost, zero-shot dialogue state tracking (DST), which tracks user's requirements in task-oriented dialogues without training on desired domains, draws attention increasingly. Although prior works have leveraged question-answering (QA) data to reduce the need for in-domain training in DST, they fail to explicitly model knowledge transfer and fusion for tracking dialogue states. To address this issue, we propose CoFunDST, which is trained on domain-agnostic QA datasets and directly uses candidate choices of slot-values as knowledge for zero-shot dialogue-state generation, based on a T5 pre-trained language model. Specifically, CoFunDST selects highly-relevant choices to the reference context and fuses them to initialize the decoder to constrain the model outputs. Our experimental results show that our proposed model achieves outperformed joint goal accuracy compared to existing zero-shot DST approaches in most domains on the MultiWOZ 2.1. Extensive analyses demonstrate the effectiveness of our proposed approach for improving zero-shot DST learning from QA.

📄 PDF Abstract BibTeX arXiv:2302.13013

Code (1)

youlandasu/choice-fusion 공식 구현 pytorch

Tasks

DecoderDialogue State TrackingLanguage ModelingLanguage ModellingQuestion AnsweringTransfer Learning

Methods 이 논문이 사용한 방법론

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.
Multi-Head Attention 설명 없음
Attention 설명 없음
fail 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Zero-Shot Dialogue State Tracking via Cross-Task Transfer

2021-09-10 · EMNLP 2021 11 · Zhaojiang Lin, Bing Liu, Andrea Madotto, Seungwhan Moon 외

Zero-shot transfer learning for dialogue state tracking (DST) enables us to handle a variety of task-oriented dialogue domains without the expense of collecting in-domain data. In this work, we propose to transfer the \t…

Dialogue State TrackingQuestion AnsweringTransfer Learning

NeuralWOZ: Learning to Collect Task-Oriented Dialogue via Model-Based Simulation

2021-05-30 · ACL 2021 5 · Sungdong Kim, Minsuk Chang, Sang-Woo Lee

We propose NeuralWOZ, a novel dialogue collection framework that uses model-based dialogue simulation. NeuralWOZ has two pipelined models, Collector and Labeler. Collector generates dialogues from (1) user's goal instruc…

Dialogue State TrackingMultiple-choiceTransfer Learning

MulZDG: Multilingual Code-Switching Framework for Zero-shot Dialogue Generation

2022-08-18 · COLING 2022 10 · Yongkang Liu, Shi Feng, Daling Wang, Yifei Zhang

Building dialogue generation systems in a zero-shot scenario remains a huge challenge, since the typical zero-shot approaches in dialogue generation rely heavily on large-scale pre-trained language generation models such…

Data AugmentationDialogue GenerationText Generation

Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Tracking

2021-05-10 · Zhaojiang Lin, Bing Liu, Seungwhan Moon, Paul Crook 외

Zero-shot cross-domain dialogue state tracking (DST) enables us to handle task-oriented dialogue in unseen domains without the expense of collecting in-domain data. In this paper, we propose a slot description enhanced g…

Dialogue State TrackingTransfer Learning

Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue StateTracking

2021-06-01 · NAACL 2021 4 · Zhaojiang Lin, Bing Liu, Seungwhan Moon, Paul Crook 외

Zero-shot cross-domain dialogue state tracking (DST) enables us to handle unseen domains without the expense of collecting in-domain data. In this paper, we propose a slot descriptions enhanced generative approach for ze…

Dialogue State TrackingTransfer Learning