Effective Slot Filling via Weakly-Supervised Dual-Model Learning
Slot filling is a challenging task in Spoken Language Understanding (SLU). Supervised methods usually require large amounts of annotation to maintain desirable performance. A solution to relieve the heavy dependency on labeled data is to employ bootstrapping, which leverages unlabeled data. However, bootstrapping is known to suffer from semantic drift. We argue that semantic drift can be tackled by exploiting the correlation between slot values (phrases) and their respective types. By using some particular weakly-labeled data, namely the plain phrases included in sentences, we propose a weaklysupervised slot filling approach. Our approach trains two models, namely a classifier and a tagger, which can effectively learn from each other on the weakly-labeled data. The experimental results demonstrate that our approach achieves better results than standard baselines on multiple datasets, especially in the low-resource setting.
Code (1)
Tasks
slot-fillingSlot FillingSpoken Language UnderstandingSimilar Papers 제목 키워드 기반
A weakly supervised sequence tagging and grammar induction approach to semantic frame slot filling
This paper describes continuing work on semantic frame slot filling for a command and control task using a weakly-supervised approach. We investigate the advantages of using retraining techniques that take the output of …
slot-fillingSlot FillingExploring Named Entity Recognition As an Auxiliary Task for Slot Filling in Conversational Language Understanding
Slot filling is a crucial task in the Natural Language Understanding (NLU) component of a dialogue system. Most approaches for this task rely solely on the domain-specific datasets for training. We propose a joint model …
Domain AdaptationMulti-Task Learningnamed-entity-recognitionNamed Entity Recognition+6Joint Multiple Intent Detection and Slot Filling via Self-distillation
Intent detection and slot filling are two main tasks in natural language understanding (NLU) for identifying users' needs from their utterances. These two tasks are highly related and often trained jointly. However, most…
DecoderIntent DetectionMultiple Instance LearningNatural Language Understanding+2Joint Multiple Intent Detection and Slot Filling with Supervised Contrastive Learning and Self-Distillation
Multiple intent detection and slot filling are two fundamental and crucial tasks in spoken language understanding. Motivated by the fact that the two tasks are closely related, joint models that can detect intents and ex…
Contrastive LearningIntent DetectionSemantic Frame Parsingslot-filling+2Distant-Supervised Slot-Filling for E-Commerce Queries
Slot-filling refers to the task of annotating individual terms in a query with the corresponding intended product characteristics (product type, brand, gender, size, color, etc.). These characteristics can then be used b…
Retrievalslot-fillingSlot Filling