Pronoun Translation in English-French Machine Translation: An Analysis of Error Types
Pronouns are a long-standing challenge in machine translation. We present a study of the performance of a range of rule-based, statistical and neural MT systems on pronoun translation based on an extensive manual evaluation using the PROTEST test suite, which enables a fine-grained analysis of different pronoun types and sheds light on the difficulties of the task. We find that the rule-based approaches in our corpus perform poorly as a result of oversimplification, whereas SMT and early NMT systems exhibit significant shortcomings due to a lack of awareness of the functional and referential properties of pronouns. A recent Transformer-based NMT system with cross-sentence context shows very promising results on non-anaphoric pronouns and intra-sentential anaphora, but there is still considerable room for improvement in examples with cross-sentence dependencies.
Code (1)
Tasks
Machine TranslationNMTSentenceTranslationSimilar Papers 제목 키워드 기반
A Test Set for Discourse Translation from Japanese to English
We made a test set for Japanese-to-English discourse translation to evaluate the power of context-aware machine translation. For each discourse phenomenon, we systematically collected examples where the translation of th…
Machine TranslationSentenceTranslationWhat about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns
As 3rd-person pronoun usage shifts to include novel forms, e.g., neopronouns, we need more research on identity-inclusive NLP. Exclusion is particularly harmful in one of the most popular NLP applications, machine transl…
Machine TranslationTranslationData augmentation using back-translation for context-aware neural machine translation
A single sentence does not always convey information that is enough to translate it into other languages. Some target languages need to add or specialize words that are omitted or ambiguous in the source languages (e.g, …
Data AugmentationMachine TranslationNMTSentence+1Discourse-level Annotation over Europarl for Machine Translation: Connectives and Pronouns
This paper describes methods and results for the annotation of two discourse-level phenomena, connectives and pronouns, over a multilingual parallel corpus. Excerpts from Europarl in English and French have been annotate…
Machine TranslationTranslationAnalyzing the Attention Heads for Pronoun Disambiguation in Context-aware Machine Translation Models
In this paper, we investigate the role of attention heads in Context-aware Machine Translation models for pronoun disambiguation in the English-to-German and English-to-French language directions. We analyze their influe…
Machine Translation