TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models
Transferring knowledge from one domain to another is of practical importance for many tasks in natural language processing, especially when the amount of available data in the target domain is limited. In this work, we propose a novel few-shot approach to domain adaptation in the context of Named Entity Recognition (NER). We propose a two-step approach consisting of a variable base module and a template module that leverages the knowledge captured in pre-trained language models with the help of simple descriptive patterns. Our approach is simple yet versatile and can be applied in few-shot and zero-shot settings. Evaluating our lightweight approach across a number of different datasets shows that it can boost the performance of state-of-the-art baselines by 2-5% F1-score.
Code (1)
Tasks
DescriptiveDomain Adaptationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition
Fine-tuning pre-trained language models has recently become a common practice in building NLP models for various tasks, especially few-shot tasks. We argue that under the few-shot setting, formulating fine-tuning closer …
Few-shot NERLanguage ModelingLanguage ModellingMeta-Learning+2MANER: Mask Augmented Named Entity Recognition for Extreme Low-Resource Languages
This paper investigates the problem of Named Entity Recognition (NER) for extreme low-resource languages with only a few hundred tagged data samples. NER is a fundamental task in Natural Language Processing (NLP). A crit…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2Few-shot Named Entity Recognition with Joint Token and Sentence Awareness
Few-shot learning has been proposed and rapidly emerging as a viable means for completing various tasks. Recently, few-shot models have been used for Named Entity Recognition (NER). Prototypical network shows high effici…
Few-Shot LearningFew-shot NERNamed Entity RecognitionNamed Entity Recognition (NER)+3COPNER: Contrastive Learning with Prompt Guiding for Few-shot Named Entity Recognition
Distance metric learning has become a popular solution for few-shot Named Entity Recognition (NER). The typical setup aims to learn a similarity metric for measuring the semantic similarity between test samples and refer…
Contrastive Learningfew-shot-nerFew-shot NERMetric Learning+6A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER
The objective of few-shot named entity recognition is to identify named entities with limited labeled instances. Previous works have primarily focused on optimizing the traditional token-wise classification framework, wh…
Contrastive Learningfew-shot-nerFew-shot NERLanguage Modeling+5