Vector Projection Network for Few-shot Slot Tagging in Natural Language Understanding
Few-shot slot tagging becomes appealing for rapid domain transfer and adaptation, motivated by the tremendous development of conversational dialogue systems. In this paper, we propose a vector projection network for few-shot slot tagging, which exploits projections of contextual word embeddings on each target label vector as word-label similarities. Essentially, this approach is equivalent to a normalized linear model with an adaptive bias. The contrastive experiment demonstrates that our proposed vector projection based similarity metric can significantly surpass other variants. Specifically, in the five-shot setting on benchmarks SNIPS and NER, our method outperforms the strongest few-shot learning baseline by $6.30$ and $13.79$ points on F$_1$ score, respectively. Our code will be released at https://github.com/sz128/few_shot_slot_tagging_and_NER.
Code (1)
Tasks
Few-Shot LearningNatural Language UnderstandingNERWord EmbeddingsSimilar Papers 제목 키워드 기반
Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network
In this paper, we explore the slot tagging with only a few labeled support sentences (a.k.a. few-shot). Few-shot slot tagging faces a unique challenge compared to the other few-shot classification problems as it calls fo…
Few-Shot LearningGeneral ClassificationFew-shot Learning for Slot Tagging with Attentive Relational Network
Metric-based learning is a well-known family of methods for few-shot learning, especially in computer vision. Recently, they have been used in many natural language processing applications but not for slot tagging. In th…
Few-Shot LearningFew-Shot NLU with Vector Projection Distance and Abstract Triangular CRF
Data sparsity problem is a key challenge of Natural Language Understanding (NLU), especially for a new target domain. By training an NLU model in source domains and applying the model to an arbitrary target domain direct…
intent-classificationIntent ClassificationIntent Classification and Slot FillingNatural Language Understanding+3Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging
Prompting methods recently achieve impressive success in few-shot learning. These methods modify input samples with prompt sentence pieces, and decode label tokens to map samples to corresponding labels. However, such a …
Few-Shot LearningPredictionSentenceEnhancing Slot Tagging with Intent Features for Task Oriented Natural Language Understanding using BERT
Recent joint intent detection and slot tagging models have seen improved performance when compared to individual models. In many real-world datasets, the slot labels and values have a strong correlation with their intent…
Intent DetectionNatural Language Understanding