Algorithms for automatic intents extraction and utterances classification for goal-oriented dialogue systems
Modern machine learning techniques in the natural language processing domain can be used to automatically generate scripts for goal-oriented dialogue systems. The current article presents a general framework for studying the automatic generation of scripts for goal-oriented dialogue systems. A method for preprocessing dialog data sets in JSON format is described. A comparison is made of two methods for extracting user intent based on BERTopic and latent Dirichlet allocation. A comparison has been made of two implemented algorithms for classifying statements of users of a goal-oriented dialogue system based on logistic regression and BERT transformer models. The BERT transformer approach using the bert-base-uncased model showed better results for the three metrics Precision (0.80), F1-score (0.78) and Matthews correlation coefficient (0.74) in comparison with other methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Goal-Oriented Dialogue SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Automatic Discovery of Novel Intents & Domains from Text Utterances
One of the primary tasks in Natural Language Understanding (NLU) is to recognize the intents as well as domains of users' spoken and written language utterances. Most existing research formulates this as a supervised cla…
General ClassificationNatural Language UnderstandingTransfer LearningZero-shot User Intent Detection via Capsule Neural Networks
User intent detection plays a critical role in question-answering and dialog systems. Most previous works treat intent detection as a classification problem where utterances are labeled with predefined intents. However, …
Intent DetectionQuestion AnsweringTransfer LearningZero-Shot LearningSingle Example Can Improve Zero-Shot Data Generation
Sub-tasks of intent classification, such as robustness to distribution shift, adaptation to specific user groups and personalization, out-of-domain detection, require extensive and flexible datasets for experiments and e…
intent-classificationIntent ClassificationText GenerationA Single Example Can Improve Zero-Shot Data Generation
Sub-tasks of intent classification, such as robustness to distribution shift, adaptation to specific user groups and personalization, out-of-domain detection, require extensive and flexible datasets for experiments and e…
intent-classificationIntent ClassificationText GenerationGeneralized Zero-shot Intent Detection via Commonsense Knowledge
Identifying user intents from natural language utterances is a crucial step in conversational systems that has been extensively studied as a supervised classification problem. However, in practice, new intents emerge aft…
Intent Detection