Transfer Learning for Related Languages: Submissions to the WMT20 Similar Language Translation Task
In this paper, we describe IIT Delhi’s submissions to the WMT 2020 task on Similar Language Translation for four language directions: Hindi <-> Marathi and Spanish <-> Portuguese. We try out three different model settings for the translation task and select our primary and contrastive submissions on the basis of performance of these three models. For our best submissions, we fine-tune the mBART model on the parallel data provided for the task. The pre-training is done using self-supervised objectives on a large amount of monolingual data for many languages. Overall, our models are ranked in the top four of all systems for the submitted language pairs, with first rank in Spanish -> Portuguese.
Code (0)
등록된 구현이 없습니다.
Tasks
Transfer LearningTranslationSimilar Papers 제목 키워드 기반
Improving Polish to English Neural Machine Translation with Transfer Learning: Effects of Data Volume and Language Similarity
This paper investigates the impact of data volume and the use of similar languages on transfer learning in a machine translation task. We find out that having more data generally leads to better performance, as it allows…
Machine TranslationTransfer LearningTranslationUParse: the Edinburgh system for the CoNLL 2017 UD shared task
This paper presents our submissions for the CoNLL 2017 UD Shared Task. Our parser, called UParse, is based on a neural network graph-based dependency parser. The parser uses features from a bidirectional LSTM to to produ…
Dependency ParsingMachine TranslationQuestion AnsweringSentence+1The CoNLL--SIGMORPHON 2018 Shared Task: Universal Morphological Reinflection
The CoNLL--SIGMORPHON 2018 shared task on supervised learning of morphological generation featured data sets from 103 typologically diverse languages. Apart from extending the number of languages involved in earlier supe…
LEMMATask 2SemEval-2024 Task 1: Semantic Textual Relatedness for African and Asian Languages
We present the first shared task on Semantic Textual Relatedness (STR). While earlier shared tasks primarily focused on semantic similarity, we instead investigate the broader phenomenon of semantic relatedness across 14…
Semantic SimilaritySemantic Textual SimilaritySentenceImproving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noise
Cross-lingual transfer between a high-resource language and its dialects or closely related language varieties should be facilitated by their similarity. However, current approaches that operate in the embedding space do…
Cross-Lingual TransferPOSPOS TaggingZero-Shot Cross-Lingual Transfer