Attention-based Semantic Priming for Slot-filling
The problem of sequence labelling in language understanding would benefit from approaches inspired by semantic priming phenomena. We propose that an attention-based RNN architecture can be used to simulate semantic priming for sequence labelling. Specifically, we employ pre-trained word embeddings to characterize the semantic relationship between utterances and labels. We validate the approach using varying sizes of the ATIS and MEDIA datasets, and show up to 1.4-1.9{\%} improvement in F1 score. The developed framework can enable more explainable and generalizable spoken language understanding systems.
Code (0)
등록된 구현이 없습니다.
Tasks
slot-fillingSlot FillingSpoken Language UnderstandingWord EmbeddingsSimilar Papers 제목 키워드 기반
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction
Attention-based recurrent neural network models for joint intent detection and slot filling have achieved the state-of-the-art performance, while they have independent attention weights. Considering that slot and intent …
global-optimizationIntent DetectionSentenceslot-filling+3Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks
Intent detection and slot filling are two fundamental tasks for building a spoken language understanding (SLU) system. Multiple deep learning-based joint models have demonstrated excellent results on the two tasks. In th…
Graph AttentionIntent Detectionslot-fillingSlot Filling+1Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks
Spoken language understanding, usually including intent detection and slot filling, is a core component to build a spoken dialog system. Recent research shows promising results by jointly learning of those two tasks base…
Decoderglobal-optimizationIntent Detectionslot-filling+3A Fast Attention Network for Joint Intent Detection and Slot Filling on Edge Devices
Intent detection and slot filling are two main tasks in natural language understanding and play an essential role in task-oriented dialogue systems. The joint learning of both tasks can improve inference accuracy and is …
Intent DetectionNatural Language Understandingslot-fillingSlot Filling+1Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling
Joint intent detection and slot filling is a key research topic in natural language understanding (NLU). Existing joint intent and slot filling systems analyze and compute features collectively for all slot types, and im…
Intent DetectionNatural Language Understandingslot-fillingSlot Filling