Meta-Learning for Few-Shot Named Entity Recognition

2021-08-01 · ACL (MetaNLP) 2021 8 · Cyprien de Lichy, Hadrien Glaude, William Campbell

Meta-learning has recently been proposed to learn models and algorithms that can generalize from a handful of examples. However, applications to structured prediction and textual tasks pose challenges for meta-learning algorithms. In this paper, we apply two meta-learning algorithms, Prototypical Networks and Reptile, to few-shot Named Entity Recognition (NER), including a method for incorporating language model pre-training and Conditional Random Fields (CRF). We propose a task generation scheme for converting classical NER datasets into the few-shot setting, for both training and evaluation. Using three public datasets, we show these meta-learning algorithms outperform a reasonable fine-tuned BERT baseline. In addition, we propose a novel combination of Prototypical Networks and Reptile.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling Meta-Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER Structured Prediction

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

2022-04-12 · Findings (ACL) 2022 5 · Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao 외

Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the proble…

Entity Typing Few-shot NER Meta-Learning Named Entity Recognition+1

Simple and Effective Few-Shot Named Entity Recognition with Structured Nearest Neighbor Learning

2020-10-06 · EMNLP 2020 11 · Yi Yang, Arzoo Katiyar

We present a simple few-shot named entity recognition (NER) system based on nearest neighbor learning and structured inference. Our system uses a supervised NER model trained on the source domain, as a feature extractor.…

Few-shot NER Meta-Learning Named Entity Recognition Named Entity Recognition (NER)

Few-shot Name Entity Recognition on StackOverflow

2024-04-15 · Xinwei Chen, Kun Li, Tianyou Song, Jiangjian Guo

StackOverflow, with its vast question repository and limited labeled examples, raise an annotation challenge for us. We address this gap by proposing RoBERTa+MAML, a few-shot named entity recognition (NER) method leverag…

Meta-Learning named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)+1

Few-shot classification in Named Entity Recognition Task

2018-12-14 · Alexander Fritzler, Varvara Logacheva, Maksim Kretov

For many natural language processing (NLP) tasks the amount of annotated data is limited. This urges a need to apply semi-supervised learning techniques, such as transfer learning or meta-learning. In this work we tackle…

Classification General Classification Meta-Learning Metric Learning+6

Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognition

2021-08-26 · LREC 2022 6 · Elena V. Epure, Romain Hennequin

Despite impressive results of language models for named entity recognition (NER), their generalization to varied textual genres, a growing entity type set, and new entities remains a challenge. Collecting thousands of an…