Back Translation Survey for Improving Text Augmentation
Natural Language Processing (NLP) relies heavily on training data. Transformers, as they have gotten bigger, have required massive amounts of training data. To satisfy this requirement, text augmentation should be looked at as a way to expand your current dataset and to generalize your models. One text augmentation we will look at is translation augmentation. We take an English sentence and translate it to another language before translating it back to English. In this paper, we look at the effect of 108 different language back translations on various metrics and text embeddings.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSurveyText AugmentationTranslationSimilar Papers 제목 키워드 기반
Low Resource Text Classification with ULMFit and Backtranslation
In computer vision, virtually every state-of-the-art deep learning system is trained with data augmentation. In text classification, however, data augmentation is less widely practiced because it must be performed before…
ClassificationData AugmentationGeneral Classificationtext-classification+1Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
The advent of Large Language Models (LLMs) has significantly reshaped the landscape of machine translation (MT), particularly for low-resource languages and domains that lack sufficient parallel corpora, linguistic tools…
Cross-Lingual TransferDecoderMachine Translationparameter-efficient fine-tuning+3Back-Translation-Style Data Augmentation for Mandarin Chinese Polyphone Disambiguation
Conversion of Chinese Grapheme-to-Phoneme (G2P) plays an important role in Mandarin Chinese Text-To-Speech (TTS) systems, where one of the biggest challenges is the task of polyphone disambiguation. Most of the previous …
Data AugmentationMachine TranslationPolyphone disambiguationPseudo Label+3Neural Machine Translation: A Review and Survey
The field of machine translation (MT), the automatic translation of written text from one natural language into another, has experienced a major paradigm shift in recent years. Statistical MT, which mainly relies on vari…
DecoderMachine TranslationNMTSentence+3Text Data Augmentation: Towards better detection of spear-phishing emails
Text data augmentation, i.e., the creation of new textual data from an existing text, is challenging. Indeed, augmentation transformations should take into account language complexity while being relevant to the target N…
Data AugmentationGeneral ClassificationLanguage ModelingLanguage Modelling+6