Learn to Focus: Hierarchical Dynamic Copy Network for Dialogue State Tracking
Recently, researchers have explored using the encoder-decoder framework to tackle dialogue state tracking (DST), which is a key component of task-oriented dialogue systems. However, they regard a multi-turn dialogue as a flat sequence, failing to focus on useful information when the sequence is long. In this paper, we propose a Hierarchical Dynamic Copy Network (HDCN) to facilitate focusing on the most informative turn, making it easier to extract slot values from the dialogue context. Based on the encoder-decoder framework, we adopt a hierarchical copy approach that calculates two levels of attention at the word- and turn-level, which are then renormalized to obtain the final copy distribution. A focus loss term is employed to encourage the model to assign the highest turn-level attention weight to the most informative turn. Experimental results show that our model achieves 46.76% joint accuracy on the MultiWOZ 2.1 dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderDialogue State TrackingTask-Oriented Dialogue SystemsSimilar Papers 제목 키워드 기반
DeepCopy: Grounded Response Generation with Hierarchical Pointer Networks
Recent advances in neural sequence-to-sequence models have led to promising results for several language generation-based tasks, including dialogue response generation, summarization, and machine translation. However, th…
DecoderMachine TranslationResponse GenerationText Generation+1A Copy-Augmented Sequence-to-Sequence Architecture Gives Good Performance on Task-Oriented Dialogue
Task-oriented dialogue focuses on conversational agents that participate in user-initiated dialogues on domain-specific topics. In contrast to chatbots, which simply seek to sustain open-ended meaningful discourse, exist…
Response GenerationLearning to Memorize in Neural Task-Oriented Dialogue Systems
In this thesis, we leverage the neural copy mechanism and memory-augmented neural networks (MANNs) to address existing challenge of neural task-oriented dialogue learning. We show the effectiveness of our strategy by ach…
Dialogue State TrackingMulti-domain Dialogue State TrackingRetrievalTask-Oriented Dialogue SystemsHierarchical Dialogue Understanding with Special Tokens and Turn-level Attention
Compared with standard text, understanding dialogue is more challenging for machines as the dynamic and unexpected semantic changes in each turn. To model such inconsistent semantics, we propose a simple but effective Hi…
Dialogue Act ClassificationDialogue UnderstandingEmotion RecognitionRelation ExtractionA Hierarchical Neural Model for Learning Sequences of Dialogue Acts
We propose a novel hierarchical Recurrent Neural Network (RNN) for learning sequences of Dialogue Acts (DAs). The input in this task is a sequence of utterances (i.e., conversational contributions) comprising a sequence …
Automatic Speech Recognition (ASR)Machine TranslationPart-Of-Speech TaggingSpeech Recognition