CLEANANERCorp: Identifying and Correcting Incorrect Labels in the ANERcorp Dataset
Label errors are a common issue in machine learning datasets, particularly for tasks such as Named Entity Recognition. Such label errors might hurt model training, affect evaluation results, and lead to an inaccurate assessment of model performance. In this study, we dived deep into one of the widely adopted Arabic NER benchmark datasets (ANERcorp) and found a significant number of annotation errors, missing labels, and inconsistencies. Therefore, in this study, we conducted empirical research to understand these errors, correct them and propose a cleaner version of the dataset named CLEANANERCorp. CLEANANERCorp will serve the research community as a more accurate and consistent benchmark.
Code (0)
등록된 구현이 없습니다.
Tasks
Missing Labelsnamed-entity-recognitionNamed Entity RecognitionNERSimilar Papers 제목 키워드 기반
An automated method of identifying incorrectly labelled images based on the sequences of loss functions of deep learning networks
Deep learning is widely applied in medical image analysis, but up to 10% of manually labelled images may be incorrect, degrading model performance. This paper proposes an automated method to identify incorrectly labelled…
CSOT: Curriculum and Structure-Aware Optimal Transport for Learning with Noisy Labels
Learning with noisy labels (LNL) poses a significant challenge in training a well-generalized model while avoiding overfitting to corrupted labels. Recent advances have achieved impressive performance by identifying clea…
DenoisingLearning with noisy labelsIdentifying Incorrect Labels in the CoNLL-2003 Corpus
The CoNLL-2003 corpus for English-language named entity recognition (NER) is one of the most influential corpora for NER model research. A large number of publications, including many landmark works, have used this corpu…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NEROn-the-fly Historical Handwritten Text Annotation
The performance of information retrieval algorithms depends upon the availability of ground truth labels annotated by experts. This is an important prerequisite, and difficulties arise when the annotated ground truth lab…
Information RetrievalRetrievaltext annotationWhen Color Constancy Goes Wrong: Correcting Improperly White-Balanced Images
This paper focuses on correcting a camera image that has been improperly white-balanced. This situation occurs when a camera's auto white balance fails or when the wrong manual white-balance setting is used. Even after d…
Color Constancy