Revisit Out-Of-Vocabulary Problem for Slot Filling: A Unified Contrastive Frameword with Multi-level Data Augmentations
In real dialogue scenarios, the existing slot filling model, which tends to memorize entity patterns, has a significantly reduced generalization facing Out-of-Vocabulary (OOV) problems. To address this issue, we propose an OOV robust slot filling model based on multi-level data augmentations to solve the OOV problem from both word and slot perspectives. We present a unified contrastive learning framework, which pull representations of the origin sample and augmentation samples together, to make the model resistant to OOV problems. We evaluate the performance of the model from some specific slots and carefully design test data with OOV word perturbation to further demonstrate the effectiveness of OOV words. Experiments on two datasets show that our approach outperforms the previous sota methods in terms of both OOV slots and words.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive Learningslot-fillingSlot FillingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Slot Filling in Spoken Language Understanding with Joint Pointer and Attention
We present a generative neural network model for slot filling based on a sequence-to-sequence (Seq2Seq) model together with a pointer network, in the situation where only sentence-level slot annotations are available in …
Sentenceslot-fillingSlot FillingSpeech Recognition+1Adversarial Semantic Decoupling for Recognizing Open-Vocabulary Slots
Open-vocabulary slots, such as file name, album name, or schedule title, significantly degrade the performance of neural-based slot filling models since these slots can take on values from a virtually unlimited set and h…
Sentenceslot-fillingSlot FillingData Augmentation by Data Noising for Open-vocabulary Slots in Spoken Language Understanding
One of the main challenges in Spoken Language Understanding (SLU) is dealing with {`}open-vocabulary{'} slots. Recently, SLU models based on neural network were proposed, but it is still difficult to recognize the slots …
Data Augmentationslot-fillingSlot FillingSpoken Language UnderstandingRevisit Input Perturbation Problems for LLMs: A Unified Robustness Evaluation Framework for Noisy Slot Filling Task
With the increasing capabilities of large language models (LLMs), these high-performance models have achieved state-of-the-art results on a wide range of natural language processing (NLP) tasks. However, the models' perf…
Data AugmentationDialogue UnderstandingSentenceslot-filling+1Unified Multi Intent Order and Slot Prediction using Selective Learning Propagation
Natural Language Understanding (NLU) involves two important task namely Intent Determination(ID) and Slot Filling (SF). With recent advancements in Intent Determination and Slot Filling tasks, explorations on handling of…
Intent DetectionNatural Language Understandingslot-fillingSlot Filling