Distantly Supervised Named Entity Recognition via Confidence-Based Multi-Class Positive and Unlabeled Learning
In this paper, we study the named entity recognition (NER) problem under distant supervision. Due to the incompleteness of the external dictionaries and/or knowledge bases, such distantly annotated training data usually suffer from a high false negative rate. To this end, we formulate the Distantly Supervised NER (DS-NER) problem via Multi-class Positive and Unlabeled (MPU) learning and propose a theoretically and practically novel CONFidence-based MPU (Conf-MPU) approach. To handle the incomplete annotations, Conf-MPU consists of two steps. First, a confidence score is estimated for each token of being an entity token. Then, the proposed Conf-MPU risk estimation is applied to train a multi-class classifier for the NER task. Thorough experiments on two benchmark datasets labeled by various external knowledge demonstrate the superiority of the proposed Conf-MPU over existing DS-NER methods.
Code (1)
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSimilar Papers 제목 키워드 기반
Distantly Supervised Named Entity Recognition with Category-Oriented Confidence Calibration
In this work, we study the noisy-labeled named entity recognition under distant supervision setting. Considering that most NER systems based on confidence estimation deal with noisy labels ignoring the fact that model ha…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERDistantly Supervised Named Entity Recognition via Confidence-Based Multi-Class Positive and Unlabeled Learning
In this paper, we study the named entity recognition (NER) problem under distant supervision. Due to the incompleteness of the external dictionaries and/or knowledge bases, such distantly annotated training data usually …
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERDenoising Distantly Supervised Named Entity Recognition via a Hypergeometric Probabilistic Model
Denoising is the essential step for distant supervision based named entity recognition. Previous denoising methods are mostly based on instance-level confidence statistics, which ignore the variety of the underlying nois…
Denoisingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training
We study the problem of training named entity recognition (NER) models using only distantly-labeled data, which can be automatically obtained by matching entity mentions in the raw text with entity types in a knowledge b…
Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+2Better Sampling of Negatives for Distantly Supervised Named Entity Recognition
Distantly supervised named entity recognition (DS-NER) has been proposed to exploit the automatically labeled training data instead of human annotations. The distantly annotated datasets are often noisy and contain a con…
named-entity-recognitionNamed Entity RecognitionNER