Subsequence Based Deep Active Learning for Named Entity Recognition
Active Learning (AL) has been successfully applied to Deep Learning in order to drastically reduce the amount of data required to achieve high performance. Previous works have shown that lightweight architectures for Named Entity Recognition (NER) can achieve optimal performance with only 25{\%} of the original training data. However, these methods do not exploit the sequential nature of language and the heterogeneity of uncertainty within each instance, requiring the labelling of whole sentences. Additionally, this standard method requires that the annotator has access to the full sentence when labelling. In this work, we overcome these limitations by allowing the AL algorithm to query subsequences within sentences, and propagate their labels to other sentences. We achieve highly efficient results on OntoNotes 5.0, only requiring 13{\%} of the original training data, and CoNLL 2003, requiring only 27{\%}. This is an improvement of 39{\%} and 37{\%} compared to querying full sentences.
Code (0)
등록된 구현이 없습니다.
Tasks
Active Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSentenceSimilar Papers 제목 키워드 기반
Hierarchical Region Learning for Nested Named Entity Recognition
Named Entity Recognition (NER) is deeply explored and widely used in various tasks. Usually, some entity mentions are nested in other entities, which leads to the nested NER problem. Leading region based models face both…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Rethinking Negative Instances for Generative Named Entity Recognition
Large Language Models (LLMs) have demonstrated impressive capabilities for generalizing in unseen tasks. In the Named Entity Recognition (NER) task, recent advancements have seen the remarkable improvement of LLMs in a b…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Constructing a Korean Named Entity Recognition Dataset for the Financial Domain using Active Learning
The performance of deep learning models depends on the quality and quantity of data. Data construction, however, is time- consuming and costly. In addition, when expert domain data are constructed, the availability of ex…
Active Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Named Entity Inclusion in Abstractive Text Summarization
We address the named entity omission - the drawback of many current abstractive text summarizers. We suggest a custom pretraining objective to enhance the model's attention on the named entities in a text. At first, the …
Abstractive Text Summarizationnamed-entity-recognitionNamed Entity RecognitionText SummarizationNaijaNER : Comprehensive Named Entity Recognition for 5 Nigerian Languages
Most of the common applications of Named Entity Recognition (NER) is on English and other highly available languages. In this work, we present our findings on Named Entity Recognition for 5 Nigerian Languages (Nigerian E…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER