Label Semantics for Few Shot Named Entity Recognition
We study the problem of few shot learning for named entity recognition. Specifically, we leverage the semantic information in the names of the labels as a way of giving the model additional signal and enriched priors. We propose a neural architecture that consists of two BERT encoders, one to encode the document and its tokens and another one to encode each of the labels in natural language format. Our model learns to match the representations of named entities computed by the first encoder with label representations computed by the second encoder. The label semantics signal is shown to support improved state-of-the-art results in multiple few shot NER benchmarks and on-par performance in standard benchmarks. Our model is especially effective in low resource settings.
Code (1)
Tasks
Few-Shot LearningFew-shot NERNamed Entity RecognitionNamed Entity Recognition (NER)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Unified Label-Aware Contrastive Learning Framework for Few-Shot Named Entity Recognition
Few-shot Named Entity Recognition (NER) aims to extract named entities using only a limited number of labeled examples. Existing contrastive learning methods often suffer from insufficient distinguishability in context v…
Contrastive Learningfew-shot-nerFew-shot NERnamed-entity-recognition+3CLLMFS: A Contrastive Learning enhanced Large Language Model Framework for Few-Shot Named Entity Recognition
Few-shot Named Entity Recognition (NER), the task of identifying named entities with only a limited amount of labeled data, has gained increasing significance in natural language processing. While existing methodologies …
Contrastive Learningfew-shot-nerFew-shot NERLanguage Modeling+7Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition
Few-shot Named Entity Recognition (NER) exploits only a handful of annotations to identify and classify named entity mentions. Prototypical network shows superior performance on few-shot NER. However, existing prototypic…
Few-shot NERMiscellaneousNamed Entity RecognitionNamed Entity Recognition (NER)Label Embedding for Zero-shot Fine-grained Named Entity Typing
Named entity typing is the task of detecting the types of a named entity in context. For instance, given {``}Eric is giving a presentation{''}, our goal is to infer that {`}Eric{'} is a speaker or a presenter and a perso…
Entity LinkingEntity TypingNamed Entity Recognition (NER)Question Answering+2Decomposed Meta-Learning for Few-Shot Named Entity Recognition
Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the proble…
Entity TypingFew-shot NERMeta-LearningNamed Entity Recognition+1