Are ambiguous conjunctions problematic for machine translation?
The translation of ambiguous words still poses challenges for machine translation. In this work, we carry out a systematic quantitative analysis regarding the ability of different machine translation systems to disambiguate the source language conjunctions {`}but{''} and {}and{''}. We evaluate specialised test sets focused on the translation of these two conjunctions. The test sets contain source languages that do not distinguish different variants of the given conjunction, whereas the target languages do. In total, we evaluate the conjunction {}but{''} on 20 translation outputs, and the conjunction {}and{''} on 10. All machine translation systems almost perfectly recognise one variant of the target conjunction, especially for the source conjunction {}but{''}. The other target variant, however, represents a challenge for machine translation systems, with accuracy varying from 50{\%} to 95{\%} for {}but{''} and from 20{\%} to 57{\%} for {`}and{''}. The major error for all systems is replacing the correct target variant with the opposite one.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Measuring and Mitigating Name Biases in Neural Machine Translation
Neural Machine Translation (NMT) systems exhibit problematic biases, such as stereotypical gender bias in the translation of occupation terms into languages with grammatical gender. In this paper we describe a new source…
Data AugmentationMachine TranslationNMTTranslationEvaluating Conjunction Disambiguation on English-to-German and French-to-German WMT 2019 Translation Hypotheses
We present a test set for evaluating an MT system{'}s capability to translate ambiguous conjunctions depending on the sentence structure. We concentrate on the English conjunction {``}but{''} and its French equivalent {`…
SentenceTranslationSplitting Compounds by Semantic Analogy
Compounding is a highly productive word-formation process in some languages that is often problematic for natural language processing applications. In this paper, we investigate whether distributional semantics in the fo…
Machine TranslationTranslationWord EmbeddingsGATE: A Challenge Set for Gender-Ambiguous Translation Examples
Although recent years have brought significant progress in improving translation of unambiguously gendered sentences, translation of ambiguously gendered input remains relatively unexplored. When source gender is ambiguo…
Machine TranslationTranslationBigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation
We present a large-scale video subtitle translation dataset, BigVideo, to facilitate the study of multi-modality machine translation. Compared with the widely used How2 and VaTeX datasets, BigVideo is more than 10 times …
Contrastive LearningMachine TranslationMultimodal Machine TranslationNMT+2