paper-with-me

Papers

Amendable Generation for Dialogue State Tracking

2021-10-29 · EMNLP (NLP4ConvAI) 2021 11 · Xin Tian, Liankai Huang, Yingzhan Lin, Siqi Bao, Huang He, Yunyi Yang, Hua Wu, Fan Wang, Shuqi Sun

In task-oriented dialogue systems, recent dialogue state tracking methods tend to perform one-pass generation of the dialogue state based on the previous dialogue state. The mistakes of these models made at the current turn are prone to be carried over to the next turn, causing error propagation. In this paper, we propose a novel Amendable Generation for Dialogue State Tracking (AG-DST), which contains a two-pass generation process: (1) generating a primitive dialogue state based on the dialogue of the current turn and the previous dialogue state, and (2) amending the primitive dialogue state from the first pass. With the additional amending generation pass, our model is tasked to learn more robust dialogue state tracking by amending the errors that still exist in the primitive dialogue state, which plays the role of reviser in the double-checking process and alleviates unnecessary error propagation. Experimental results show that AG-DST significantly outperforms previous works in two active DST datasets (MultiWOZ 2.2 and WOZ 2.0), achieving new state-of-the-art performances.

📄 PDF Abstract BibTeX arXiv:2110.15659

Code (1)

PaddlePaddle/Knover/tree/develop/projects/AG-DST 공식 구현 paddle

Tasks

Dialogue State TrackingMulti-domain Dialogue State TrackingTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…

Similar Papers 제목 키워드 기반

Explicit State Tracking with Semi-Supervision for Neural Dialogue Generation

2018-08-31 · Xisen Jin, Wenqiang Lei, Zhaochun Ren, Hongshen Chen 외

The task of dialogue generation aims to automatically provide responses given previous utterances. Tracking dialogue states is an important ingredient in dialogue generation for estimating users' intention. However, the …

DecoderDialogue GenerationDialogue State Tracking

CREDIT: Coarse-to-Fine Sequence Generation for Dialogue State Tracking

2020-09-22 · Zhi Chen, Lu Chen, Zihan Xu, Yanbin Zhao 외

In dialogue systems, a dialogue state tracker aims to accurately find a compact representation of the current dialogue status, based on the entire dialogue history. While previous approaches often define dialogue states …

Dialogue State Tracking

Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking

2022-03-03 · Findings (ACL) 2022 5 · Jamin Shin, Hangyeol Yu, Hyeongdon Moon, Andrea Madotto 외

Annotating task-oriented dialogues is notorious for the expensive and difficult data collection process. Few-shot dialogue state tracking (DST) is a realistic solution to this problem. In this paper, we hypothesize that …

Abstractive Dialogue SummarizationDialogue State TrackingLanguage ModelingLanguage Modelling+1

Multimodal Dialogue State Tracking

2022-06-16 · NAACL 2022 7 · Hung Le, Nancy F. Chen, Steven C. H. Hoi

Designed for tracking user goals in dialogues, a dialogue state tracker is an essential component in a dialogue system. However, the research of dialogue state tracking has largely been limited to unimodality, in which s…

Dialogue State TrackingVideo Understanding

Visual Dialogue State Tracking for Question Generation

2019-11-12 · Wei Pang, Xiaojie Wang

GuessWhat?! is a visual dialogue task between a guesser and an oracle. The guesser aims to locate an object supposed by the oracle oneself in an image by asking a sequence of Yes/No questions. Asking proper questions wit…

Dialogue State TrackingQuestion GenerationQuestion-GenerationVisual Dialog