Backtranslation Feedback Improves User Confidence in MT, Not Quality
Translating text into a language unknown to the text's author, dubbed outbound translation, is a modern need for which the user experience has significant room for improvement, beyond the basic machine translation facility. We demonstrate this by showing three ways in which user confidence in the outbound translation, as well as its overall final quality, can be affected: backward translation, quality estimation (with alignment) and source paraphrasing. In this paper, we describe an experiment on outbound translation from English to Czech and Estonian. We examine the effects of each proposed feedback module and further focus on how the quality of machine translation systems influence these findings and the user perception of success. We show that backward translation feedback has a mixed effect on the whole process: it increases user confidence in the produced translation, but not the objective quality.
Code (1)
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Physician Detection of Clinical Harm in Machine Translation: Quality Estimation Aids in Reliance and Backtranslation Identifies Critical Errors
A major challenge in the practical use of Machine Translation (MT) is that users lack guidance to make informed decisions about when to rely on outputs. Progress in quality estimation research provides techniques to auto…
Decision MakingMachine TranslationShould I Share this Translation? Evaluating Quality Feedback for User Reliance on Machine Translation
As people increasingly use AI systems in work and daily life, feedback mechanisms that help them use AI responsibly are urgently needed, particularly in settings where users are not equipped to assess the quality of AI p…
Machine TranslationTranslationBoosting Neural Machine Translation from Finnish to Northern Sámi with Rule-Based Backtranslation
We consider a low-resource translation task from Finnish into Northern Sámi. Collecting all available parallel data between the languages, we obtain around 30,000 sentence pairs. However, there exists a significantly lar…
Machine TranslationNMTSentenceTranslationLean-ing on Quality: How High-Quality Data Beats Diverse Multilingual Data in AutoFormalization
Autoformalization, the process of transforming informal mathematical language into formal specifications and proofs remains a difficult task for state-of-the-art (large) language models. Existing works point to competing…
MathLow Resource Text Classification with ULMFit and Backtranslation
In computer vision, virtually every state-of-the-art deep learning system is trained with data augmentation. In text classification, however, data augmentation is less widely practiced because it must be performed before…
ClassificationData AugmentationGeneral Classificationtext-classification+1