Parallel Corpus Augmentation using Masked Language Models
In this paper we propose a novel method of augmenting parallel text corpora which promises good quality and is also capable of producing many fold larger corpora than the seed corpus we start with. We do not need any additional monolingual corpora. We use Multi-Lingual Masked Language Model to mask and predict alternative words in context and we use Sentence Embeddings to check and select sentence pairs which are likely to be translations of each other. We cross check our method using metrics for MT Quality Estimation. We believe this method can greatly alleviate the data scarcity problem for all language pairs for which a reasonable seed corpus is available.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingSentenceSentence EmbeddingsSimilar Papers 제목 키워드 기반
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining
Existing models of multilingual sentence embeddings require large parallel data resources which are not available for low-resource languages. We propose a novel unsupervised method to derive multilingual sentence embeddi…
Language ModelingLanguage ModellingMachine TranslationParallel Corpus Mining+4Corpus Augmentation by Sentence Segmentation for Low-Resource Neural Machine Translation
Neural Machine Translation (NMT) has been proven to achieve impressive results. The NMT system translation results depend strongly on the size and quality of parallel corpora. Nevertheless, for many language pairs, no ri…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMT+3Enabling Code-Mixed Translation: Parallel Corpus Creation and MT Augmentation Approach
Code-mixing, use of two or more languages in a single sentence, is ubiquitous; generated by multi-lingual speakers across the world. The phenomenon presents itself prominently in social media discourse. Consequently, the…
Machine TranslationSentenceTranslationTowards a Broad Coverage Named Entity Resource: A Data-Efficient Approach for Many Diverse Languages
Parallel corpora are ideal for extracting a multilingual named entity (MNE) resource, i.e., a dataset of names translated into multiple languages. Prior work on extracting MNE datasets from parallel corpora required reso…
Bilingual Lexicon InductionTransliterationData Augmentation for Neural Machine Translation using Generative Language Model
Despite the rapid growth in model architecture, the scarcity of large parallel corpora remains the main bottleneck in Neural Machine Translation. Data augmentation is a technique that enhances the performance of data-hun…
Data AugmentationDiversityLanguage ModelingLanguage Modelling+2