TRANSLIT: A Large-scale Name Transliteration Resource
Transliteration is the process of expressing a proper name from a source language in the characters of a target language (e.g. from Cyrillic to Latin characters). We present TRANSLIT, a large-scale corpus with approx. 1.6 million entries in more than 180 languages with about 3 million variations of person and geolocation names. The corpus is based on various public data sources, which have been transformed into a unified format to simplify their usage, plus a newly compiled dataset from Wikipedia. In addition, we apply several machine learning methods to establish baselines for automatically detecting transliterated names in various languages. Our best systems achieve an accuracy of 92{\%} on identification of transliterated pairs.
Code (0)
등록된 구현이 없습니다.
Tasks
TransliterationSimilar Papers 제목 키워드 기반
Sideways Transliteration: How to Transliterate Multicultural Person Names?
In a global setting, texts contain transliterated names from many cultural origins. Correct transliteration depends not only on target and source languages but also, on the source language of the name. We introduce a nov…
TransliterationCross-lingual Named Entity List Search via Transliteration
Out-of-vocabulary words are still a challenge in cross-lingual Natural Language Processing tasks, for which transliteration from source to target language or script is one of the solutions. In this study, we collect a pe…
TransliterationPhonology-Augmented Statistical Framework for Machine Transliteration using Limited Linguistic Resources
Transliteration converts words in a source language (e.g., English) into words in a target language (e.g., Vietnamese). This conversion considers the phonological structure of the target language, as the transliterated o…
TransliterationArabic to English Person Name Transliteration using Twitter
Social media outlets are providing new opportunities for harvesting valuable resources. We present a novel approach for mining data from Twitter for the purpose of building transliteration resources and systems. Such res…
RetrievalTranslationTransliterationAksharantar: Open Indic-language Transliteration datasets and models for the Next Billion Users
Transliteration is very important in the Indian language context due to the usage of multiple scripts and the widespread use of romanized inputs. However, few training and evaluation sets are publicly available. We intro…
Transliteration