A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelism
We show that content on the web is often translated into many languages, and the low quality of these multi-way translations indicates they were likely created using Machine Translation (MT). Multi-way parallel, machine generated content not only dominates the translations in lower resource languages; it also constitutes a large fraction of the total web content in those languages. We also find evidence of a selection bias in the type of content which is translated into many languages, consistent with low quality English content being translated en masse into many lower resource languages, via MT. Our work raises serious concerns about training models such as multilingual large language models on both monolingual and bilingual data scraped from the web.
Code (1)
Tasks
Machine TranslationSelection biasSimilar Papers 제목 키워드 기반
Resource Creation and Evaluation for Multilingual Sentiment Analysis in Social Media Texts
This paper presents an evaluation of the use of machine translation to obtain and employ data for training multilingual sentiment classifiers. We show that the use of machine translated data obtained similar results as t…
ClassificationGeneral ClassificationMachine TranslationNatural Language Inference+4El Departamento de Nosotros: How Machine Translated Corpora Affects Language Models in MRC Tasks
Pre-training large-scale language models (LMs) requires huge amounts of text corpora. LMs for English enjoy ever growing corpora of diverse language resources. However, less resourced languages and their mono- and multil…
Machine TranslationQuestion AnsweringTransfer LearningTranslationOn the Influence of Machine Translation on Language Origin Obfuscation
In the last decade, machine translation has become a popular means to deal with multilingual digital content. By providing higher quality translations, obfuscating the source language of a text becomes more attractive. I…
Machine TranslationTranslationSelecting Backtranslated Data from Multiple Sources for Improved Neural Machine Translation
Machine translation (MT) has benefited from using synthetic training data originating from translating monolingual corpora, a technique known as backtranslation. Combining backtranslated data from different sources has l…
DiversityMachine TranslationTranslationSignature Methods in Machine Learning
Signature-based techniques give mathematical insight into the interactions between complex streams of evolving data. These insights can be quite naturally translated into numerical approaches to understanding streamed da…
BIG-bench Machine LearningSurvey