Constructing Uyghur Name Entity Recognition System using Neural Machine Translation Tag Projection
Although named entity recognition achieved great success by introducing the neural networks, it is challenging to apply these models to low resource languages including Uyghur while it depends on a large amount of annotated training data. Constructing a well-annotated named entity corpus manually is very time-consuming and labor-intensive. Most existing methods based on the parallel corpus combined with the word alignment tools. However, word alignment methods introduce alignment errors inevitably. In this paper, we address this problem by a named entity tag transfer method based on the common neural machine translation. The proposed method marks the entity boundaries in Chinese sentence and translates the sentences to Uyghur by neural machine translation system, hope that neural machine translation will align the source and target entity by the self-attention mechanism. The experimental results show that the Uyghur named entity recognition system trained by the constructed corpus achieve good performance on the test set, with 73.80% F1 score(3.79% improvement by baseline)
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)SentenceTAGTranslationWord AlignmentSimilar Papers 제목 키워드 기반
Adapting Word Embeddings to New Languages with Morphological and Phonological Subword Representations
Much work in Natural Language Processing (NLP) has been for resource-rich languages, making generalization to new, less-resourced languages challenging. We present two approaches for improving generalization to low-resou…
AvgMachine Translationnamed-entity-recognitionNamed Entity Recognition+5Morphological Analysis Corpus Construction of Uyghur
“Morphological analysis is a fundamental task in natural language processing and results can beapplied to different downstream tasks such as named entity recognition syntactic analysis andmachine translation. However the…
LEMMALemmatizationMorphological Analysisnamed-entity-recognition+3Joint Extraction of Uyghur Medicine Knowledge with Edge Computing
Medical knowledge extraction methods based on edge computing deploy deep learning models on edge devices to achieve localized entity and relation extraction. This approach avoids transferring substantial sensitive data t…
Edge-computingRelation ExtractionSentenceAutomatic Speech Recognition for Uyghur through Multilingual Acoustic Modeling
Low-resource languages suffer from lower performance of Automatic Speech Recognition (ASR) system due to the lack of data. As a common approach, multilingual training has been applied to achieve more context coverage and…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech RecognitionNeural Cross-Lingual Named Entity Recognition with Minimal Resources
For languages with no annotated resources, unsupervised transfer of natural language processing models such as named-entity recognition (NER) from resource-rich languages would be an appealing capability. However, differ…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1