To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation
We conduct a large-scale fine-grained comparative analysis of machine translations (MT) against human translations (HT) through the lens of morphosyntactic divergence. Across three language pairs and two types of divergence defined as the structural difference between the source and the target, MT is consistently more conservative than HT, with less morphosyntactic diversity, more convergent patterns, and more one-to-one alignments. Through analysis on different decoding algorithms, we attribute this discrepancy to the use of beam search that biases MT towards more convergent patterns. This bias is most amplified when the convergent pattern appears around 50% of the time in training data. Lastly, we show that for a majority of morphosyntactic divergences, their presence in HT is correlated with decreased MT performance, presenting a greater challenge for MT systems.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeDiversityMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Translation Divergences in Chinese--English Machine Translation: An Empirical Investigation
In this article, we conduct an empirical investigation of translation divergences between Chinese and English relying on a parallel treebank. To do this, we first devise a hierarchical alignment scheme where Chinese and …
Machine TranslationTranslationMachine Translation in Indian Languages: Challenges and Resolution
English to Indian language machine translation poses the challenge of structural and morphological divergence. This paper describes English to Indian language statistical machine translation using pre-ordering and suffix…
Machine TranslationTranslationBeyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation
While it has been shown that Neural Machine Translation (NMT) is highly sensitive to noisy parallel training samples, prior work treats all types of mismatches between source and target as noise. As a result, it remains …
Machine TranslationNMTTranslationFixing Translation Divergences in Parallel Corpora for Neural MT
Corpus-based approaches to machine translation rely on the availability of clean parallel corpora. Such resources are scarce, and because of the automatic processes involved in their preparation, they are often noisy. Th…
Machine TranslationSentenceSentence SimilarityTranslationPenalizing Divergence: Multi-Parallel Translation for Low-Resource Languages of North America
This paper explores a special case in multilingual machine translation: so called multi-parallel translation, where the target data for all language pairs are identical. While multi-parallelism offers benefits which are …
Machine TranslationTranslation