Precognition in Task-oriented Dialogue Understanding: Posterior Regularization by Future Context
Task-oriented dialogue systems have become overwhelmingly popular in recent researches. Dialogue understanding is widely used to comprehend users' intent, emotion and dialogue state in task-oriented dialogue systems. Most previous works on such discriminative tasks only models current query or historical conversations. Even if in some work the entire dialogue flow was modeled, it is not suitable for the real-world task-oriented conversations as the future contexts are not visible in such cases. In this paper, we propose to jointly model historical and future information through the posterior regularization method. More specifically, by modeling the current utterance and past contexts as prior, and the entire dialogue flow as posterior, we optimize the KL distance between these distributions to regularize our model during training. And only historical information is used for inference. Extensive experiments on two dialogue datasets validate the effectiveness of our proposed method, achieving superior results compared with all baseline models.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue UnderstandingTask-Oriented Dialogue SystemsSimilar Papers 제목 키워드 기반
Explicit State Tracking with Semi-Supervision for Neural Dialogue Generation
The task of dialogue generation aims to automatically provide responses given previous utterances. Tracking dialogue states is an important ingredient in dialogue generation for estimating users' intention. However, the …
DecoderDialogue GenerationDialogue State TrackingDialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue
A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Eva…
Domain AdaptationMulti-domain Dialogue State TrackingNatural Language UnderstandingTaming Continuous Posteriors for Latent Variational Dialogue Policies
Utilizing amortized variational inference for latent-action reinforcement learning (RL) has been shown to be an effective approach in Task-oriented Dialogue (ToD) systems for optimizing dialogue success. Until now, categ…
reinforcement-learningReinforcement Learning (RL)Variational InferenceTOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue
The underlying difference of linguistic patterns between general text and task-oriented dialogue makes existing pre-trained language models less useful in practice. In this work, we unify nine human-human and multi-turn …
Dialogue State TrackingIntent DetectionLanguage ModelingLanguage Modelling+2Semantics-Enhanced Task-Oriented Dialogue Translation: A Case Study on Hotel Booking
We showcase TODAY, a semantics-enhanced task-oriented dialogue translation system, whose novelties are: (i) task-oriented named entity (NE) definition and a hybrid strategy for NE recognition and translation; and (ii) a …
Dialogue UnderstandingMachine TranslationManagementNamed Entity Recognition (NER)+1