Sequential Convolutional Neural Networks for Slot Filling in Spoken Language Understanding
We investigate the usage of convolutional neural networks (CNNs) for the slot filling task in spoken language understanding. We propose a novel CNN architecture for sequence labeling which takes into account the previous context words with preserved order information and pays special attention to the current word with its surrounding context. Moreover, it combines the information from the past and the future words for classification. Our proposed CNN architecture outperforms even the previously best ensembling recurrent neural network model and achieves state-of-the-art results with an F1-score of 95.61% on the ATIS benchmark dataset without using any additional linguistic knowledge and resources.
Code (0)
등록된 구현이 없습니다.
Tasks
General Classificationslot-fillingSlot FillingSpoken Language UnderstandingSimilar Papers 제목 키워드 기반
Combining Word Feature Vector Method with the Convolutional Neural Network for Slot Filling in Spoken Language Understanding
Slot filling is an important problem in Spoken Language Understanding (SLU) and Natural Language Processing (NLP), which involves identifying a user's intent and assigning a semantic concept to each word in a sentence. T…
Sentenceslot-fillingSlot FillingSpoken Language UnderstandingSyntactic Graph Convolutional Network for Spoken Language Understanding
Slot filling and intent detection are two major tasks for spoken language understanding. In most existing work, these two tasks are built as joint models with multi-task learning with no consideration of prior linguistic…
Intent DetectionMulti-Task Learningslot-fillingSlot Filling+1A Graph-to-Sequence Model for Joint Intent Detection and Slot Filling in Task-Oriented Dialogue Systems
Effectively decoding semantic frames in task-oriented dialogue systems remains a challenge, which typically includes intent detection and slot filling. Although RNN-based neural models show promising results by jointly l…
Decoderglobal-optimizationGraph-to-SequenceIntent Detection+4Improving Slot Filling in Spoken Language Understanding with Joint Pointer and Attention
We present a generative neural network model for slot filling based on a sequence-to-sequence (Seq2Seq) model together with a pointer network, in the situation where only sentence-level slot annotations are available in …
Sentenceslot-fillingSlot FillingSpeech Recognition+1Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks
Spoken language understanding, usually including intent detection and slot filling, is a core component to build a spoken dialog system. Recent research shows promising results by jointly learning of those two tasks base…
Decoderglobal-optimizationIntent Detectionslot-filling+3