Data Augmentation for Neural Machine Translation using Generative Language Model
Despite the rapid growth in model architecture, the scarcity of large parallel corpora remains the main bottleneck in Neural Machine Translation. Data augmentation is a technique that enhances the performance of data-hungry models by generating synthetic data instead of collecting new ones. We explore prompt-based data augmentation approaches that leverage large-scale language models such as ChatGPT. To create a synthetic parallel corpus, we compare 3 methods using different prompts. We employ two assessment metrics to measure the diversity of the generated synthetic data. This approach requires no further model training cost, which is mandatory in other augmentation methods like back-translation. The proposed method improves the unaugmented baseline by 0.68 BLEU score.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDiversityLanguage ModelingLanguage ModellingMachine TranslationTranslationSimilar Papers 제목 키워드 기반
The Only Chance to Understand: Machine Translation of the Severely Endangered Low-resource Languages of Eurasia
Numerous machine translation systems have been proposed since the appearance of this task. Nowadays, new large language model-based algorithms show results that sometimes overcome human ones on the rich-resource language…
Data AugmentationLanguage ModelingLanguage ModellingLarge Language Model+2High-Quality Data Augmentation for Low-Resource NMT: Combining a Translation Memory, a GAN Generator, and Filtering
Back translation, as a technique for extending a dataset, is widely used by researchers in low-resource language translation tasks. It typically translates from the target to the source language to ensure high-quality tr…
Data AugmentationGenerative Adversarial NetworkLow Resource NMTMachine Translation+3From Scarcity to Efficiency: Investigating the Effects of Data Augmentation on African Machine Translation
The linguistic diversity across the African continent presents different challenges and opportunities for machine translation. This study explores the effects of data augmentation techniques in improving translation syst…
Machine TranslationData AugmentationNeural Machine Translation Data Generation and Augmentation using ChatGPT
Neural models have revolutionized the field of machine translation, but creating parallel corpora is expensive and time-consuming. We investigate an alternative to manual parallel corpora - hallucinated parallel corpora …
DiversityMachine TranslationTranslationTextual Augmentation Techniques Applied to Low Resource Machine Translation: Case of Swahili
In this work we investigate the impact of applying textual data augmentation tasks to low resource machine translation. There has been recent interest in investigating approaches for training systems for languages with l…
Data AugmentationMachine TranslationNMTtext-classification+2