Partially Supervised Named Entity Recognition via the Expected Entity Ratio Loss
We study learning named entity recognizers in the presence of missing entity annotations. We approach this setting as tagging with latent variables and propose a novel loss, the Expected Entity Ratio, to learn models in the presence of systematically missing tags. We show that our approach is both theoretically sound and empirically useful. Experimentally, we find that it meets or exceeds performance of strong and state-of-the-art baselines across a variety of languages, annotation scenarios, and amounts of labeled data. In particular, we find that it significantly outperforms the previous state-of-the-art methods from Mayhew et al. (2019) and Li et al. (2021) by +12.7 and +2.3 F1 score in a challenging setting with only 1,000 biased annotations, averaged across 7 datasets. We also show that, when combined with our approach, a novel sparse annotation scheme outperforms exhaustive annotation for modest annotation budgets.
Code (1)
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Similar Papers 제목 키워드 기반
Named Entity Recognition with Partially Annotated Training Data
Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We study the problem of Named Entity Recognit…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERNamed Entity Recognition for Partially Annotated Datasets
The most common Named Entity Recognizers are usually sequence taggers trained on fully annotated corpora, i.e. the class of all words for all entities is known. Partially annotated corpora, i.e. some but not all entities…
Allnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition
Named entity recognition (NER) is a well-studied task in natural language processing. Traditional NER research only deals with flat entities and ignores nested entities. The span-based methods treat entity recognition as…
Chinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2Latvian and Lithuanian Named Entity Recognition with TildeNER
In this paper the author presents TildeNER ― an open source freely available named entity recognition toolkit and the first multi-class named entity recognition system for Latvian and Lithuanian languages. The system i…
Machine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Nested Named Entity Recognition with Partially-Observed TreeCRFs
Named entity recognition (NER) is a well-studied task in natural language processing. However, the widely-used sequence labeling framework is difficult to detect entities with nested structures. In this work, we view nes…
Constituency Parsingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2