It's not a Non-Issue: Negation as a Source of Error in Machine Translation
As machine translation (MT) systems progress at a rapid pace, questions of their adequacy linger. In this study we focus on negation, a universal, core property of human language that significantly affects the semantics of an utterance. We investigate whether translating negation is an issue for modern MT systems using 17 translation directions as test bed. Through thorough analysis, we find that indeed the presence of negation can significantly impact downstream quality, in some cases resulting in quality reductions of more than 60%. We also provide a linguistically motivated analysis that directly explains the majority of our findings. We release our annotations and code to replicate our analysis here: https://github.com/mosharafhossain/negation-mt.
Code (1)
Tasks
Machine TranslationNegationTranslationSimilar Papers 제목 키워드 기반
Revisiting Negation in Neural Machine Translation
In this paper, we evaluate the translation of negation both automatically and manually, in English--German (EN--DE) and English--Chinese (EN--ZH). We show that the ability of neural machine translation (NMT) models to tr…
de-enMachine TranslationNegationNMT+1Evaluation of Chinese-English Machine Translation of Emotion-Loaded Microblog Texts: A Human Annotated Dataset for the Quality Assessment of Emotion Translation
In this paper, we focus on how current Machine Translation (MT) tools perform on the translation of emotion-loaded texts by evaluating outputs from Google Translate according to a framework proposed in this paper. We pro…
Machine TranslationNegationTranslationUse of Modality and Negation in Semantically-Informed Syntactic MT
This paper describes the resource- and system-building efforts of an eight-week Johns Hopkins University Human Language Technology Center of Excellence Summer Camp for Applied Language Exploration (SCALE-2009) on Semanti…
Machine TranslationNegationTranslationEnriching Parallel Corpora for Statistical Machine Translation with Semantic Negation Rephrasing
Negation and Modality in Machine Translation
Negation and modality are two important grammatical phenomena that have attracted recent research attention as they can contribute to extra-propositional meaning aspects, among with factuality, attribution, irony and sar…
Machine TranslationNegationSemantic Role LabelingSentiment Analysis+1