A Semi-Supervised BERT Approach for Arabic Named Entity Recognition
Named entity recognition (NER) plays a significant role in many applications such as information extraction, information retrieval, question answering, and even machine translation. Most of the work on NER using deep learning was done for non-Arabic languages like English and French, and only few studies focused on Arabic. This paper proposes a semi-supervised learning approach to train a BERT-based NER model using labeled and semi-labeled datasets. We compared our approach against various baselines, and state-of-the-art Arabic NER tools on three datasets: AQMAR, NEWS, and TWEETS. We report a significant improvement in F-measure for the AQMAR and the NEWS datasets, which are written in Modern Standard Arabic (MSA), and competitive results for the TWEETS dataset, which contains tweets that are mostly in the Egyptian dialect and contain many mistakes or misspellings.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalMachine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERQuestion AnsweringRetrievalTranslationSimilar Papers 제목 키워드 기반
A Semi-supervised Learning Approach to Arabic Named Entity Recognition
An Empirical Study of Pre-trained Transformers for Arabic Information Extraction
Multilingual pre-trained Transformers, such as mBERT (Devlin et al., 2019) and XLM-RoBERTa (Conneau et al., 2020a), have been shown to enable the effective cross-lingual zero-shot transfer. However, their performance on …
Cross-Lingual TransferLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+8Combining Minimally-supervised Methods for Arabic Named Entity Recognition
Supervised methods can achieve high performance on NLP tasks, such as Named Entity Recognition (NER), but new annotations are required for every new domain and/or genre change. This has motivated research in minimally su…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Wojood: Nested Arabic Named Entity Corpus and Recognition using BERT
This paper presents Wojood, a corpus for Arabic nested Named Entity Recognition (NER). Nested entities occur when one entity mention is embedded inside another entity mention. Wojood consists of about 550K Modern Standar…
Multi-Task Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2Cross-Lingual NER for Financial Transaction Data in Low-Resource Languages
We propose an efficient modeling framework for cross-lingual named entity recognition in semi-structured text data. Our approach relies on both knowledge distillation and consistency training. The modeling framework leve…
Cross-Lingual NERKnowledge DistillationLanguage ModellingLarge Language Model+3