Language Branch Gated Multilingual Neural Machine Translation
Knowledge transfer across languages is crucial for multilingual neural machine translation. In this paper, we propose language branch (LB) gated multilingual neural machine translation that encourages knowledge transfer within the same language branch with a LB-gated module that is integrated into both the encoder and decoder. The LB-gated module distinguishes LB-specific parameters from global parameters shared by all languages and routes languages from the same LB to the corresponding LB-specific network. Comprehensive experiments on the OPUS-100 dataset show that the proposed approach substantially improves translation quality on both middle- and low-resource languages over previous methods. Further analysis demonstrates its ability in learning similarities between language branches.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderMachine TranslationTransfer LearningTranslationSimilar Papers 제목 키워드 기반
A Study of Multilingual Neural Machine Translation
Multilingual neural machine translation (NMT) has recently been investigated from different aspects (e.g., pivot translation, zero-shot translation, fine-tuning, or training from scratch) and in different settings (e.g.,…
DecoderMachine TranslationNMTTranslationMaastricht University’s Large-Scale Multilingual Machine Translation System for WMT 2021
We present our development of the multilingual machine translation system for the large-scale multilingual machine translation task at WMT 2021. Starting form the provided baseline system, we investigated several techniq…
Machine TranslationTranslationCross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation
Cross-lingual Machine Reading Comprehension (CLMRC) remains a challenging problem due to the lack of large-scale annotated datasets in low-source languages, such as Arabic, Hindi, and Vietnamese. Many previous approaches…
Knowledge DistillationMachine Reading ComprehensionReading ComprehensionTranslationInvestigation of Multilingual Neural Machine Translation for Indian Languages
In the domain of natural language processing, machine translation is a well-defined task where one natural language is automatically translated to another natural language. The deep learning-based approach of machine tra…
Machine TranslationTranslationTransliterationLVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation
Multimodal Machine Translation (MMT) focuses on enhancing text-only translation with visual features, which has attracted considerable attention from both natural language processing and computer vision communities. Rece…
Machine TranslationMultimodal Machine TranslationTranslation