TenTrans Large-Scale Multilingual Machine Translation System for WMT21
This paper describes TenTrans large-scale multilingual machine translation system for WMT 2021. We participate in the Small Track 2 in five South East Asian languages, thirty directions: Javanese, Indonesian, Malay, Tagalog, Tamil, English. We mainly utilized forward/back-translation, in-domain data selection, knowledge distillation, and gradual fine-tuning from the pre-trained model FLORES-101. We find that forward/back-translation significantly improves the translation results, data selection and gradual fine-tuning are particularly effective during adapting domain, while knowledge distillation brings slight performance improvement. Also, model averaging is used to further improve the translation performance based on these systems. Our final system achieves an average BLEU score of 28.89 across thirty directions on the test set.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationMachine TranslationTranslationSimilar Papers 제목 키워드 기반
TenTrans Multilingual Low-Resource Translation System for WMT21 Indo-European Languages Task
This paper describes TenTrans’ submission to WMT21 Multilingual Low-Resource Translation shared task for the Romance language pairs. This task focuses on improving translation quality from Catalan to Occitan, Romanian an…
Transfer LearningTranslationTencentFmRD Neural Machine Translation for WMT18
This paper describes the Neural Machine Translation (NMT) system of TencentFmRD for Chinese↔English news translation tasks of WMT 2018. Our systems are neural machine translation systems trained with our original system …
Machine TranslationNMTRerankingTranslationTenTrans High-Performance Inference Toolkit for WMT2021 Efficiency Task
The paper describes the TenTrans’s submissions to the WMT 2021 Efficiency Shared Task. We explore training a variety of smaller compact transformer models using the teacher-student setup. Our model is trained by our self…
Vocal Bursts Intensity PredictionMaastricht University’s Large-Scale Multilingual Machine Translation System for WMT 2021
We present our development of the multilingual machine translation system for the large-scale multilingual machine translation task at WMT 2021. Starting form the provided baseline system, we investigated several techniq…
Machine TranslationTranslationBack-translation for Large-Scale Multilingual Machine Translation
This paper illustrates our approach to the shared task on large-scale multilingual machine translation in the sixth conference on machine translation (WMT-21). This work aims to build a single multilingual translation sy…
Machine TranslationTranslation