Developing neural machine translation models for Hungarian-English
I train models for the task of neural machine translation for English-Hungarian and Hungarian-English, using the Hunglish2 corpus. The main contribution of this work is evaluating different data augmentation methods during the training of NMT models. I propose 5 different augmentation methods that are structure-aware, meaning that instead of randomly selecting words for blanking or replacement, the dependency tree of sentences is used as a basis for augmentation. I start my thesis with a detailed literature review on neural networks, sequential modeling, neural machine translation, dependency parsing and data augmentation. After a detailed exploratory data analysis and preprocessing of the Hunglish2 corpus, I perform experiments with the proposed data augmentation techniques. The best model for Hungarian-English achieves a BLEU score of 33.9, while the best model for English-Hungarian achieves a BLEU score of 28.6.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDependency ParsingMachine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Syntax-based data augmentation for Hungarian-English machine translation
We train Transformer-based neural machine translation models for Hungarian-English and English-Hungarian using the Hunglish2 corpus. Our best models achieve a BLEU score of 40.0 on HungarianEnglish and 33.4 on English-Hu…
Data AugmentationMachine TranslationTranslationLight Verb Constructions in the SzegedParalellFX English--Hungarian Parallel Corpus
In this paper, we describe the first English-Hungarian parallel corpus annotated for light verb constructions, which contains 14,261 sentence alignment units. Annotation principles and statistical data on the corpus are …
Machine TranslationRetrievalSentenceTranslationEnglish to Hungarian Morpheme-based Statistical Machine Translation System with Reordering Rules
How to Measure Gender Bias in Machine Translation: Optimal Translators, Multiple Reference Points
In this paper, as a case study, we present a systematic study of gender bias in machine translation with Google Translate. We translated sentences containing names of occupations from Hungarian, a language with gender-ne…
Machine TranslationTranslationAccessing Higher Dimensions for Unsupervised Word Translation
The striking ability of unsupervised word translation has been demonstrated recently with the help of low-dimensional word vectors / pretraining, which is used by all successful methods and assumed to be necessary. We te…