Transformer-based Named Entity Recognition with Combined Data Representation
This study examines transformer-based models and their effectiveness in named entity recognition tasks. The study investigates data representation strategies, including single, merged, and context, which respectively use one sentence, multiple sentences, and sentences joined with attention to context per vector. Analysis shows that training models with a single strategy may lead to poor performance on different data representations. To address this limitation, the study proposes a combined training procedure that utilizes all three strategies to improve model stability and adaptability. The results of this approach are presented and discussed for four languages (English, Polish, Czech, and German) across various datasets, demonstrating the effectiveness of the combined strategy.
Code (0)
등록된 구현이 없습니다.
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)SentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Research on Named Entity Recognition in Improved transformer with R-Drop structure
To enhance the generalization ability of the model and improve the effectiveness of the transformer for named entity recognition tasks, the XLNet-Transformer-R model is proposed in this paper. The XLNet pre-trained model…
named-entity-recognitionNamed Entity RecognitionA multimodal deep learning approach for named entity recognition from social media
Named Entity Recognition (NER) from social media posts is a challenging task. User generated content that forms the nature of social media, is noisy and contains grammatical and linguistic errors. This noisy content make…
Information RetrievalMultimodal Deep Learningnamed-entity-recognitionNamed Entity Recognition+2Transformer-Based Named Entity Recognition for Automated Server Provisioning
This paper introduces a novel method for automated server provisioning by integrating Transformerbased Named Entity Recognition models with Automated Speech Detection using OpenAI's Whisper. Leveraging advanced Transform…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+3NaijaNER : Comprehensive Named Entity Recognition for 5 Nigerian Languages
Most of the common applications of Named Entity Recognition (NER) is on English and other highly available languages. In this work, we present our findings on Named Entity Recognition for 5 Nigerian Languages (Nigerian E…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERNamed Entity Recognition in Historic Legal Text: A Transformer and State Machine Ensemble Method
Older legal texts are often scanned and digitized via Optical Character Recognition (OCR), which results in numerous errors. Although spelling and grammar checkers can correct much of the scanned text automatically, Name…
Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+4