On the Use of Machine Translation-Based Approaches for Vietnamese Diacritic Restoration
This paper presents an empirical study of two machine translation-based approaches for Vietnamese diacritic restoration problem, including phrase-based and neural-based machine translation models. This is the first work that applies neural-based machine translation method to this problem and gives a thorough comparison to the phrase-based machine translation method which is the current state-of-the-art method for this problem. On a large dataset, the phrase-based approach has an accuracy of 97.32% while that of the neural-based approach is 96.15%. While the neural-based method has a slightly lower accuracy, it is about twice faster than the phrase-based method in terms of inference speed. Moreover, neural-based machine translation method has much room for future improvement such as incorporating pre-trained word embeddings and collecting more training data.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationWord EmbeddingsSimilar Papers 제목 키워드 기반
Homograph Disambiguation Through Selective Diacritic Restoration
Lexical ambiguity, a challenging phenomenon in all natural languages, is particularly prevalent for languages with diacritics that tend to be omitted in writing, such as Arabic. Omitting diacritics leads to an increase i…
Machine TranslationPart-Of-Speech TaggingSemantic Textual SimilarityTranslationEfficient Convolutional Neural Networks for Diacritic Restoration
Diacritic restoration has gained importance with the growing need for machines to understand written texts. The task is typically modeled as a sequence labeling problem and currently Bidirectional Long Short Term Memory …
Vietnamese Text Accent Restoration with Statistical Machine Translation
Attentive Sequence-to-Sequence Learning for Diacritic Restoration of Yorùbá Language Text
Yor\`ub\'a is a widely spoken West African language with a writing system rich in tonal and orthographic diacritics. With very few exceptions, diacritics are omitted from electronic texts, due to limited device and appli…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine Translationspeech-recognition+4Investigating the Impact of Various Partial Diacritization Schemes on Arabic-English Statistical Machine Translation
Most diacritics in Arabic represent short vowels. In Arabic orthography, such diacritics are considered optional. The absence of these diacritics naturally leads to significant word ambiguity to top the inherent ambiguit…
Machine TranslationTranslation