OCR Improves Machine Translation for Low-Resource Languages
We aim to investigate the performance of current OCR systems on low resource languages and low resource scripts. We introduce and make publicly available a novel benchmark, OCR4MT, consisting of real and synthetic data, enriched with noise, for 60 low-resource languages in low resource scripts. We evaluate state-of-the-art OCR systems on our benchmark and analyse most common errors. We show that OCR monolingual data is a valuable resource that can increase performance of Machine Translation models, when used in backtranslation. We then perform an ablation study to investigate how OCR errors impact Machine Translation performance and determine what is the minimum level of OCR quality needed for the monolingual data to be useful for Machine Translation.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationOptical Character Recognition (OCR)TranslationSimilar Papers 제목 키워드 기반
A Survey of Orthographic Information in Machine Translation
Machine translation is one of the applications of natural language processing which has been explored in different languages. Recently researchers started paying attention towards machine translation for resource-poor la…
Bilingual Lexicon InductionMachine TranslationSurveyTranslationLove Thy Neighbor: Combining Two Neighboring Low-Resource Languages for Translation
Low-resource languages sometimes take on similar morphological and syntactic characteristics due to their geographic nearness and shared history. Two low-resource neighboring languages found in Peru, Quechua and Ashanink…
Machine TranslationTransfer LearningTranslationVocal Bursts Valence PredictionLow-Resource Machine Translation Using Cross-Lingual Language Model Pretraining
This paper describes UTokyo’s submission to the AmericasNLP 2021 Shared Task on machine translation systems for indigenous languages of the Americas. We present a low-resource machine translation system that improves tra…
Language ModelingLanguage ModellingMachine TranslationTranslationAdapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data
The scarcity of parallel data is a major obstacle for training high-quality machine translation systems for low-resource languages. Fortunately, some low-resource languages are linguistically related or similar to high-r…
DenoisingMachine TranslationNMTTranslationLeveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation
Over the last few years two promising research directions in low-resource neural machine translation (NMT) have emerged. The first focuses on utilizing high-resource languages to improve the quality of low-resource langu…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMT+1