paper-with-me

홈 › Papers

Vector Projection Network for Few-shot Slot Tagging in Natural Language Understanding

2020-09-21 · Su Zhu, Ruisheng Cao, Lu Chen, Kai Yu

Few-shot slot tagging becomes appealing for rapid domain transfer and adaptation, motivated by the tremendous development of conversational dialogue systems. In this paper, we propose a vector projection network for few-shot slot tagging, which exploits projections of contextual word embeddings on each target label vector as word-label similarities. Essentially, this approach is equivalent to a normalized linear model with an adaptive bias. The contrastive experiment demonstrates that our proposed vector projection based similarity metric can significantly surpass other variants. Specifically, in the five-shot setting on benchmarks SNIPS and NER, our method outperforms the strongest few-shot learning baseline by $6.30$ and $13.79$ points on F$_1$ score, respectively. Our code will be released at https://github.com/sz128/few_shot_slot_tagging_and_NER.

📄 PDF Abstract BibTeX arXiv:2009.09568

Code (1)

sz128/few_shot_slot_tagging_and_NER 공식 구현 pytorch

Tasks

Few-Shot LearningNatural Language UnderstandingNERWord Embeddings

Similar Papers 제목 키워드 기반

Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network

2020-06-10 · ACL 2020 6 · Yutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou 외

In this paper, we explore the slot tagging with only a few labeled support sentences (a.k.a. few-shot). Few-shot slot tagging faces a unique challenge compared to the other few-shot classification problems as it calls fo…

Few-Shot LearningGeneral Classification

Few-shot Learning for Slot Tagging with Attentive Relational Network

2021-03-03 · EACL 2021 2 · Cennet Oguz, Ngoc Thang Vu

Metric-based learning is a well-known family of methods for few-shot learning, especially in computer vision. Recently, they have been used in many natural language processing applications but not for slot tagging. In th…

Few-Shot Learning

Few-Shot NLU with Vector Projection Distance and Abstract Triangular CRF

2021-12-09 · Su Zhu, Lu Chen, Ruisheng Cao, Zhi Chen 외

Data sparsity problem is a key challenge of Natural Language Understanding (NLU), especially for a new target domain. By training an NLU model in source domains and applying the model to an arbitrary target domain direct…

intent-classificationIntent ClassificationIntent Classification and Slot FillingNatural Language Understanding+3

Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging

2022-04-02 · Findings (ACL) 2022 5 · Yutai Hou, Cheng Chen, Xianzhen Luo, Bohan Li 외

Prompting methods recently achieve impressive success in few-shot learning. These methods modify input samples with prompt sentence pieces, and decode label tokens to map samples to corresponding labels. However, such a …

Few-Shot LearningPredictionSentence

Enhancing Slot Tagging with Intent Features for Task Oriented Natural Language Understanding using BERT

2022-05-19 · Shruthi Hariharan, Vignesh Kumar Krishnamurthy, Utkarsh, Jayantha Gowda Sarapanahalli

Recent joint intent detection and slot tagging models have seen improved performance when compared to individual models. In many real-world datasets, the slot labels and values have a strong correlation with their intent…

Intent DetectionNatural Language Understanding