Deep Cascade Multi-task Learning for Slot Filling in Online Shopping Assistant
Slot filling is a critical task in natural language understanding (NLU) for dialog systems. State-of-the-art approaches treat it as a sequence labeling problem and adopt such models as BiLSTM-CRF. While these models work relatively well on standard benchmark datasets, they face challenges in the context of E-commerce where the slot labels are more informative and carry richer expressions. In this work, inspired by the unique structure of E-commerce knowledge base, we propose a novel multi-task model with cascade and residual connections, which jointly learns segment tagging, named entity tagging and slot filling. Experiments show the effectiveness of the proposed cascade and residual structures. Our model has a 14.6% advantage in F1 score over the strong baseline methods on a new Chinese E-commerce shopping assistant dataset, while achieving competitive accuracies on a standard dataset. Furthermore, online test deployed on such dominant E-commerce platform shows 130% improvement on accuracy of understanding user utterances. Our model has already gone into production in the E-commerce platform.
Code (1)
Tasks
Multi-Task LearningNatural Language Understandingslot-fillingSlot FillingSimilar Papers 제목 키워드 기반
SpeechLLMs for Large-scale Contextualized Zero-shot Slot Filling
Slot filling is a crucial subtask in spoken language understanding (SLU), traditionally implemented as a cascade of speech recognition followed by one or more natural language understanding (NLU) components. The recent a…
Natural Language UnderstandingSpoken Language UnderstandingZero-shot Slot FillingSpeech RecognitionLeveraging Non-Conversational Tasks for Low Resource Slot Filling: Does it help?
Slot filling is a core operation for utterance understanding in task-oriented dialogue systems. Slots are typically domain-specific, and adding new domains to a dialogue system involves data and time-intensive processes.…
Multi-Task Learningslot-fillingSlot FillingTask-Oriented Dialogue Systems+1Bi-directional Joint Neural Networks for Intent Classification and Slot Filling
Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks proceeded independently. However, more recently joint models for intent classification and slo…
Classificationintent-classificationIntent ClassificationIntent Classification and Slot Filling+4Joint Online Spoken Language Understanding and Language Modeling with Recurrent Neural Networks
Speaker intent detection and semantic slot filling are two critical tasks in spoken language understanding (SLU) for dialogue systems. In this paper, we describe a recurrent neural network (RNN) model that jointly perfor…
BenchmarkingIntent DetectionLanguage ModelingLanguage Modelling+3Exploring Named Entity Recognition As an Auxiliary Task for Slot Filling in Conversational Language Understanding
Slot filling is a crucial task in the Natural Language Understanding (NLU) component of a dialogue system. Most approaches for this task rely solely on the domain-specific datasets for training. We propose a joint model …
Domain AdaptationMulti-Task Learningnamed-entity-recognitionNamed Entity Recognition+6