paper-with-me

홈 › Papers

Dialogue State Distillation Network with Inter-slot Contrastive Learning for Dialogue State Tracking

2023-02-16 · Jing Xu, Dandan song, Chong Liu, Siu Cheung Hui, Fei Li, Qiang Ju, Xiaonan He, Jian Xie

In task-oriented dialogue systems, Dialogue State Tracking (DST) aims to extract users' intentions from the dialogue history. Currently, most existing approaches suffer from error propagation and are unable to dynamically select relevant information when utilizing previous dialogue states. Moreover, the relations between the updates of different slots provide vital clues for DST. However, the existing approaches rely only on predefined graphs to indirectly capture the relations. In this paper, we propose a Dialogue State Distillation Network (DSDN) to utilize relevant information of previous dialogue states and migrate the gap of utilization between training and testing. Thus, it can dynamically exploit previous dialogue states and avoid introducing error propagation simultaneously. Further, we propose an inter-slot contrastive learning loss to effectively capture the slot co-update relations from dialogue context. Experiments are conducted on the widely used MultiWOZ 2.0 and MultiWOZ 2.1 datasets. The experimental results show that our proposed model achieves the state-of-the-art performance for DST.

📄 PDF Abstract BibTeX arXiv:2302.08220

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDialogue State TrackingTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

2024-05-31 · Xuxin Cheng, Wanshi Xu, Zhihong Zhu, Hongxiang Li 외

Spoken language understanding (SLU) is a core task in task-oriented dialogue systems, which aims at understanding the user's current goal through constructing semantic frames. SLU usually consists of two subtasks, includ…

Contrastive LearningIntent Detectionslot-fillingSlot Filling+2

Dynamic Knowledge Fusion for Multi-Domain Dialogue State Tracking

2026-03-11 · Haoxiang Su, Ruiyu Fang, Liting Jiang, Xiaomeng Huang 외 arxiv

The performance of task-oriented dialogue models is strongly tied to how well they track dialogue states, which records and updates user information across multi-turn interactions. However, current multi-domain DST encou…

Dialogue State TrackingContrastive Learning

MoNET: Tackle State Momentum via Noise-Enhanced Training for Dialogue State Tracking

2022-11-10 · Haoning Zhang, Junwei Bao, Haipeng Sun, Youzheng Wu 외

Dialogue state tracking (DST) aims to convert the dialogue history into dialogue states which consist of slot-value pairs. As condensed structural information memorizing all history information, the dialogue state in the…

Dialogue State Tracking

MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU

2024-08-15 · Yan Li, So-Eon Kim, Seong-Bae Park, Soyeon Caren Han

Although Large Language Models(LLMs) can generate coherent and contextually relevant text, they often struggle to recognise the intent behind the human user's query. Natural Language Understanding (NLU) models, however, …

domain classificationIntent DetectionKnowledge DistillationNatural Language Understanding+3

HierarchicalContrast: A Coarse-to-Fine Contrastive Learning Framework for Cross-Domain Zero-Shot Slot Filling

2023-10-13 · Junwen Zhang, Yin Zhang

In task-oriented dialogue scenarios, cross-domain zero-shot slot filling plays a vital role in leveraging source domain knowledge to learn a model with high generalization ability in unknown target domain where annotated…

Contrastive Learningslot-fillingSlot FillingTransfer Learning+1