E-NER: Evidential Deep Learning for Trustworthy Named Entity Recognition
Most named entity recognition (NER) systems focus on improving model performance, ignoring the need to quantify model uncertainty, which is critical to the reliability of NER systems in open environments. Evidential deep learning (EDL) has recently been proposed as a promising solution to explicitly model predictive uncertainty for classification tasks. However, directly applying EDL to NER applications faces two challenges, i.e., the problems of sparse entities and OOV/OOD entities in NER tasks. To address these challenges, we propose a trustworthy NER framework named E-NER by introducing two uncertainty-guided loss terms to the conventional EDL, along with a series of uncertainty-guided training strategies. Experiments show that E-NER can be applied to multiple NER paradigms to obtain accurate uncertainty estimation. Furthermore, compared to state-of-the-art baselines, the proposed method achieves a better OOV/OOD detection performance and better generalization ability on OOV entities.
Code (1)
Tasks
Deep Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Integrating Large Pre-trained Models into Multimodal Named Entity Recognition with Evidential Fusion
Multimodal Named Entity Recognition (MNER) is a crucial task for information extraction from social media platforms such as Twitter. Most current methods rely on attention weights to extract information from both text an…
named-entity-recognitionNamed Entity RecognitionTurkish Named Entity Recognition: A Survey and Comparative Analysis
Named entity recognition is a challenging task that has been widely studied in English. Although there are some efforts for named entity recognition in Turkish language, the reported results are limited to particular dat…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)SurveyANEC: An Amharic Named Entity Corpus and Transformer Based Recognizer
Named Entity Recognition is an information extraction task that serves as a preprocessing step for other natural language processing tasks, such as machine translation, information retrieval, and question answering. Name…
imbalanced classificationInformation RetrievalMachine Translationnamed-entity-recognition+4Boosting Cross-Lingual Transfer via Self-Learning with Uncertainty Estimation
Recent multilingual pre-trained language models have achieved remarkable zero-shot performance, where the model is only finetuned on one source language and directly evaluated on target languages. In this work, we propos…
Cross-Lingual Transfernamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3A Survey of Named Entity Recognition in Assamese and other Indian Languages
Named Entity Recognition is always important when dealing with major Natural Language Processing tasks such as information extraction, question-answering, machine translation, document summarization etc so in this paper …
Document SummarizationMachine Translationnamed-entity-recognitionNamed Entity Recognition+3