NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data
Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation model specialized in the Named Entity Recognition (NER) task. NuNER can be fine-tuned to solve downstream NER problems in a data-efficient way, outperforming similar-sized foundation models in the few-shot regime and competing with much larger LLMs. We find that the size and entity-type diversity of the pre-training dataset are key to achieving good performance. We view NuNER as a member of the broader family of task-specific foundation models, recently unlocked by LLMs.
Code (1)
Tasks
DiversityFew-shot NERnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERZero-shot Named Entity Recognition (NER)Similar Papers 제목 키워드 기반
Detection of Adverse Drug Events in Dutch clinical free text documents using Transformer Models: benchmark study
In this study, we establish a benchmark for adverse drug event (ADE) detection in Dutch clinical free-text documents using several transformer models, clinical scenarios, and fit-for-purpose performance measures. We trai…
Relation ClassificationGazetteer-Enhanced Attentive Neural Networks for Named Entity Recognition
Current region-based NER models only rely on fully-annotated training data to learn effective region encoder, which often face the training data bottleneck. To alleviate this problem, this paper proposes Gazetteer-Enhanc…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERAutoSpecNER: A Fine-Grained Named Entity Recognition Dataset for Vehicle Specification Extraction
Vehicle advertisements contain rich specification information, but automotive NER resources remain limited. We introduce AutoSpecNER, an expert-annotated dataset for fine-grained entity recognition in vehicle listings. T…
Named Entity Recognition for Partially Annotated Datasets
The most common Named Entity Recognizers are usually sequence taggers trained on fully annotated corpora, i.e. the class of all words for all entities is known. Partially annotated corpora, i.e. some but not all entities…
Allnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)A Deep Learning approach for Hindi Named Entity Recognition
Named Entity Recognition is one of the most important text processing requirement in many NLP tasks. In this paper we use a deep architecture to accomplish the task of recognizing named entities in a given Hindi text sen…
Deep Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3