Design Challenges in Named Entity Transliteration
We analyze some of the fundamental design challenges that impact the development of a multilingual state-of-the-art named entity transliteration system, including curating bilingual named entity datasets and evaluation of multiple transliteration methods. We empirically evaluate the transliteration task using traditional weighted finite state transducer (WFST) approach against two neural approaches: the encoder-decoder recurrent neural network method and the recent, non-sequential Transformer method. In order to improve availability of bilingual named entity transliteration datasets, we release personal name bilingual dictionaries minded from Wikidata for English to Russian, Hebrew, Arabic and Japanese Katakana. Our code and dictionaries are publicly available.
Code (1)
Tasks
DecoderTransliterationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ANETAC: Arabic Named Entity Transliteration and Classification Dataset
In this paper, we make freely accessible ANETAC our English-Arabic named entity transliteration and classification dataset that we built from freely available parallel translation corpora. The dataset contains 79,924 ins…
ClassificationGeneral ClassificationTranslationTransliteration+1Neural Machine Translation Techniques for Named Entity Transliteration
Transliterating named entities from one language into another can be approached as neural machine translation (NMT) problem, for which we use deep attentional RNN encoder-decoder models. To build a strong transliteration…
Automatic Post-EditingDecoderGrammatical Error CorrectionMachine Translation+3Report of NEWS 2018 Named Entity Transliteration Shared Task
This report presents the results from the Named Entity Transliteration Shared Task conducted as part of The Seventh Named Entities Workshop (NEWS 2018) held at ACL 2018 in Melbourne, Australia. Similar to previous editio…
Information RetrievalMachine TranslationTransliterationCross-lingual Named Entity List Search via Transliteration
Out-of-vocabulary words are still a challenge in cross-lingual Natural Language Processing tasks, for which transliteration from source to target language or script is one of the solutions. In this study, we collect a pe…
TransliterationA Myanmar (Burmese)-English Named Entity Transliteration Dictionary
Transliteration is generally a phonetically based transcription across different writing systems. It is a crucial task for various downstream natural language processing applications. For the Myanmar (Burmese) language, …
Transliteration