MphayaNER: Named Entity Recognition for Tshivenda
Named Entity Recognition (NER) plays a vital role in various Natural Language Processing tasks such as information retrieval, text classification, and question answering. However, NER can be challenging, especially in low-resource languages with limited annotated datasets and tools. This paper adds to the effort of addressing these challenges by introducing MphayaNER, the first Tshivenda NER corpus in the news domain. We establish NER baselines by \textit{fine-tuning} state-of-the-art models on MphayaNER. The study also explores zero-shot transfer between Tshivenda and other related Bantu languages, with chiShona and Kiswahili showing the best results. Augmenting MphayaNER with chiShona data was also found to improve model performance significantly. Both MphayaNER and the baseline models are made publicly available.
Code (1)
Tasks
Information Retrievalnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERQuestion AnsweringRetrievaltext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Turkish Named Entity Recognition: A Survey and Comparative Analysis
Named entity recognition is a challenging task that has been widely studied in English. Although there are some efforts for named entity recognition in Turkish language, the reported results are limited to particular dat…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)SurveyANEC: An Amharic Named Entity Corpus and Transformer Based Recognizer
Named Entity Recognition is an information extraction task that serves as a preprocessing step for other natural language processing tasks, such as machine translation, information retrieval, and question answering. Name…
imbalanced classificationInformation RetrievalMachine Translationnamed-entity-recognition+4A Survey of Named Entity Recognition in Assamese and other Indian Languages
Named Entity Recognition is always important when dealing with major Natural Language Processing tasks such as information extraction, question-answering, machine translation, document summarization etc so in this paper …
Document SummarizationMachine Translationnamed-entity-recognitionNamed Entity Recognition+3Code-Switched Named Entity Recognition with Embedding Attention
We describe our work for the CALCS 2018 shared task on named entity recognition on code-switched data. Our system ranked first place for MS Arabic-Egyptian named entity recognition and third place for English-Spanish.
Language Identificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Latvian and Lithuanian Named Entity Recognition with TildeNER
In this paper the author presents TildeNER ― an open source freely available named entity recognition toolkit and the first multi-class named entity recognition system for Latvian and Lithuanian languages. The system i…
Machine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)