Named Entity Recognition -- Is there a glass ceiling?
Recent developments in Named Entity Recognition (NER) have resulted in better and better models. However, is there a glass ceiling? Do we know which types of errors are still hard or even impossible to correct? In this paper, we present a detailed analysis of the types of errors in state-of-the-art machine learning (ML) methods. Our study reveals the weak and strong points of the Stanford, CMU, FLAIR, ELMO and BERT models, as well as their shared limitations. We also introduce new techniques for improving annotation, for training processes and for checking a model's quality and stability. Presented results are based on the CoNLL 2003 data set for the English language. A new enriched semantic annotation of errors for this data set and new diagnostic data sets are attached in the supplementary materials.
Code (1)
Tasks
Diagnosticnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Named Entity Recognition - Is There a Glass Ceiling?
Recent developments in Named Entity Recognition (NER) have resulted in better and better models. However, is there a glass ceiling? Do we know which types of errors are still hard or even impossible to correct? In this p…
BIG-bench Machine Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1The glass ceiling in NLP
In this paper, we provide empirical evidence based on a rigourously studied mathematical model for bi-populated networks, that a glass ceiling within the field of NLP has developed since the mid 2000s.
Turkish Named Entity Recognition: A Survey and Comparative Analysis
Named entity recognition is a challenging task that has been widely studied in English. Although there are some efforts for named entity recognition in Turkish language, the reported results are limited to particular dat…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)SurveyFace Synthesis for Eyeglass-Robust Face Recognition
In the application of face recognition, eyeglasses could significantly degrade the recognition accuracy. A feasible method is to collect large-scale face images with eyeglasses for training deep learning methods. However…
Deep LearningFace GenerationFace ModelFace Recognition+1A Survey of Named Entity Recognition in Assamese and other Indian Languages
Named Entity Recognition is always important when dealing with major Natural Language Processing tasks such as information extraction, question-answering, machine translation, document summarization etc so in this paper …
Document SummarizationMachine Translationnamed-entity-recognitionNamed Entity Recognition+3