paper-with-me

홈 › Papers

Automatic Intent-Slot Induction for Dialogue Systems

2021-03-16 · Zengfeng Zeng, Dan Ma, Haiqin Yang, Zhen Gou, Jianping Shen

Automatically and accurately identifying user intents and filling the associated slots from their spoken language are critical to the success of dialogue systems. Traditional methods require manually defining the DOMAIN-INTENT-SLOT schema and asking many domain experts to annotate the corresponding utterances, upon which neural models are trained. This procedure brings the challenges of information sharing hindering, out-of-schema, or data sparsity in open-domain dialogue systems. To tackle these challenges, we explore a new task of {\em automatic intent-slot induction} and propose a novel domain-independent tool. That is, we design a coarse-to-fine three-step procedure including Role-labeling, Concept-mining, And Pattern-mining (RCAP): (1) role-labeling: extracting keyphrases from users' utterances and classifying them into a quadruple of coarsely-defined intent-roles via sequence labeling; (2) concept-mining: clustering the extracted intent-role mentions and naming them into abstract fine-grained concepts; (3) pattern-mining: applying the Apriori algorithm to mine intent-role patterns and automatically inferring the intent-slot using these coarse-grained intent-role labels and fine-grained concepts. Empirical evaluations on both real-world in-domain and out-of-domain datasets show that: (1) our RCAP can generate satisfactory SLU schema and outperforms the state-of-the-art supervised learning method; (2) our RCAP can be directly applied to out-of-domain datasets and gain at least 76\% improvement of F1-score on intent detection and 41\% improvement of F1-score on slot filling; (3) our RCAP exhibits its power in generic intent-slot extractions with less manual effort, which opens pathways for schema induction on new domains and unseen intent-slot discovery for generalizable dialogue systems.

📄 PDF Abstract BibTeX arXiv:2103.08886

Code (0)

등록된 구현이 없습니다.

Tasks

Intent Detectionslot-fillingSlot Filling

Similar Papers 제목 키워드 기반

Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11

2023-04-25 · James Gung, Raphael Shu, Emily Moeng, Wesley Rose 외

With increasing demand for and adoption of virtual assistants, recent work has investigated ways to accelerate bot schema design through the automatic induction of intents or the induction of slots and dialogue states. H…

Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learning

2023-08-09 · Hoang H. Nguyen, Chenwei Zhang, Ye Liu, Philip S. Yu

Recent advanced methods in Natural Language Understanding for Task-oriented Dialogue (TOD) Systems (e.g., intent detection and slot filling) require a large amount of annotated data to achieve competitive performance. In…

Contrastive LearningIntent DetectionLanguage ModelingLanguage Modelling+4

Multi-Stage Coarse-to-Fine Contrastive Learning for Conversation Intent Induction

2023-03-09 · Caiyuan Chu, Ya Li, Yifan Liu, Jia-Chen Gu 외

Intent recognition is critical for task-oriented dialogue systems. However, for emerging domains and new services, it is difficult to accurately identify the key intent of a conversation due to time-consuming data annota…

ClusteringContrastive LearningIntent RecognitionSentence+1

Transforming Slot Schema Induction with Generative Dialogue State Inference

2024-08-03 · James D. Finch, Boxin Zhao, Jinho D. Choi

The challenge of defining a slot schema to represent the state of a task-oriented dialogue system is addressed by Slot Schema Induction (SSI), which aims to automatically induce slots from unlabeled dialogue data. Wherea…

Foundations of Collaborative Task-Oriented Dialogue: What's in a Slot?

2019-09-01 · WS 2019 9 · Philip Cohen

In this paper, we examine the foundations of task-oriented dialogues, in which systems are requested to perform tasks for humans. We argue that the way this dialogue task has been framed has limited its applicability to …

Task-Oriented Dialogue Systems