paper-with-me

Papers

Developing neural machine translation models for Hungarian-English

2021-11-07 · Attila Nagy

I train models for the task of neural machine translation for English-Hungarian and Hungarian-English, using the Hunglish2 corpus. The main contribution of this work is evaluating different data augmentation methods during the training of NMT models. I propose 5 different augmentation methods that are structure-aware, meaning that instead of randomly selecting words for blanking or replacement, the dependency tree of sentences is used as a basis for augmentation. I start my thesis with a detailed literature review on neural networks, sequential modeling, neural machine translation, dependency parsing and data augmentation. After a detailed exploratory data analysis and preprocessing of the Hunglish2 corpus, I perform experiments with the proposed data augmentation techniques. The best model for Hungarian-English achieves a BLEU score of 33.9, while the best model for English-Hungarian achieves a BLEU score of 28.6.

📄 PDF Abstract BibTeX arXiv:2111.04099

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationDependency ParsingMachine TranslationNMTTranslation

Similar Papers 제목 키워드 기반

Syntax-based data augmentation for Hungarian-English machine translation

2022-01-18 · Attila Nagy, Patrick Nanys, Balázs Frey Konrád, Bence Bial 외

We train Transformer-based neural machine translation models for Hungarian-English and English-Hungarian using the Hunglish2 corpus. Our best models achieve a BLEU score of 40.0 on HungarianEnglish and 33.4 on English-Hu…

Data AugmentationMachine TranslationTranslation

Light Verb Constructions in the SzegedParalellFX English--Hungarian Parallel Corpus

2012-05-01 · LREC 2012 5 · Veronika Vincze

In this paper, we describe the first English-Hungarian parallel corpus annotated for light verb constructions, which contains 14,261 sentence alignment units. Annotation principles and statistical data on the corpus are …

Machine TranslationRetrievalSentenceTranslation

English to Hungarian Morpheme-based Statistical Machine Translation System with Reordering Rules

2013-08-01 · WS 2013 8 · L{\'a}szl{\'o} Laki, Attila Nov{\'a}k, Borb{\'a}la Sikl{\'o}si
Machine TranslationTranslation

How to Measure Gender Bias in Machine Translation: Optimal Translators, Multiple Reference Points

2020-11-12 · Anna Farkas, Renáta Németh

In this paper, as a case study, we present a systematic study of gender bias in machine translation with Google Translate. We translated sentences containing names of occupations from Hungarian, a language with gender-ne…

Machine TranslationTranslation

Accessing Higher Dimensions for Unsupervised Word Translation

2023-09-21 · NeurIPS 2023 11

The striking ability of unsupervised word translation has been demonstrated recently with the help of low-dimensional word vectors / pretraining, which is used by all successful methods and assumed to be necessary. We te…