SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Filling
Slot filling and intent detection are two main tasks in spoken language understanding (SLU) system. In this paper, we propose a novel non-autoregressive model named SlotRefine for joint intent detection and slot filling. Besides, we design a novel two-pass iteration mechanism to handle the uncoordinated slots problem caused by conditional independence of non-autoregressive model. Experiments demonstrate that our model significantly outperforms previous models in slot filling task, while considerably speeding up the decoding (up to X 10.77). In-depth analyses show that 1) pretraining schemes could further enhance our model; 2) two-pass mechanism indeed remedy the uncoordinated slots.
Code (1)
Tasks
Intent Detectionslot-fillingSlot FillingSpoken Language UnderstandingSimilar Papers 제목 키워드 기반
GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling
Multi-intent SLU can handle multiple intents in an utterance, which has attracted increasing attention. However, the state-of-the-art joint models heavily rely on autoregressive approaches, resulting in two issues: slow …
Intent DetectionSemantic Frame Parsingslot-fillingSlot FillingA Fast Attention Network for Joint Intent Detection and Slot Filling on Edge Devices
Intent detection and slot filling are two main tasks in natural language understanding and play an essential role in task-oriented dialogue systems. The joint learning of both tasks can improve inference accuracy and is …
Intent DetectionNatural Language Understandingslot-fillingSlot Filling+1Non-autoregressive End-to-end Approaches for Joint Automatic Speech Recognition and Spoken Language Understanding
This paper presents the use of non-autoregressive (NAR) approaches for joint automatic speech recognition (ASR) and spoken language understanding (SLU) tasks. The proposed NAR systems employ a Conformer encoder that appl…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Decoderspeech-recognition+2The USYD-JD Speech Translation System for IWSLT2021
This paper describes the University of Sydney & JD’s joint submission of the IWSLT 2021 low resource speech translation task. We participated in the Swahili->English direction and got the best scareBLEU (25.3) score amon…
Knowledge DistillationNMTRerankingTranslationThe USYD-JD Speech Translation System for IWSLT 2021
This paper describes the University of Sydney& JD's joint submission of the IWSLT 2021 low resource speech translation task. We participated in the Swahili-English direction and got the best scareBLEU (25.3) score among …
Knowledge DistillationNMTRerankingTranslation