paper-with-me

Papers

SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task

2020-10-11 · Zuchao Li, Hai Zhao, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita

In this paper, we introduced our joint team SJTU-NICT 's participation in the WMT 2020 machine translation shared task. In this shared task, we participated in four translation directions of three language pairs: English-Chinese, English-Polish on supervised machine translation track, German-Upper Sorbian on low-resource and unsupervised machine translation tracks. Based on different conditions of language pairs, we have experimented with diverse neural machine translation (NMT) techniques: document-enhanced NMT, XLM pre-trained language model enhanced NMT, bidirectional translation as a pre-training, reference language based UNMT, data-dependent gaussian prior objective, and BT-BLEU collaborative filtering self-training. We also used the TF-IDF algorithm to filter the training set to obtain a domain more similar set with the test set for finetuning. In our submissions, the primary systems won the first place on English to Chinese, Polish to English, and German to Upper Sorbian translation directions.

📄 PDF Abstract BibTeX arXiv:2010.05122

Code (0)

등록된 구현이 없습니다.

Tasks

Collaborative FilteringLanguage ModelingLanguage ModellingMachine TranslationNMTTranslationUnsupervised Machine Translation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Residual Connection 설명 없음
Attention 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

SJTU-NICT’s Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task

2020-11-01 · WMT (EMNLP) 2020 11 · Zuchao Li, Hai Zhao, Rui Wang, Kehai Chen 외

In this paper, we introduced our joint team SJTU-NICT ‘s participation in the WMT 2020 machine translation shared task. In this shared task, we participated in four translation directions of three language pairs: English…

Collaborative FilteringLanguage ModelingLanguage ModellingMachine Translation+3

NICT's Unsupervised Neural and Statistical Machine Translation Systems for the WMT19 News Translation Task

2019-08-01 · WS 2019 8 · Benjamin Marie, Haipeng Sun, Rui Wang, Kehai Chen 외

This paper presents the NICT{'}s participation in the WMT19 unsupervised news translation task. We participated in the unsupervised translation direction: German-Czech. Our primary submission to the task is the result of…

Machine TranslationTranslationUnsupervised Machine Translation

English-Myanmar Supervised and Unsupervised NMT: NICT's Machine Translation Systems at WAT-2019

2019-11-01 · WS 2019 11 · Rui Wang, Haipeng Sun, Kehai Chen, Chenchen Ding 외

This paper presents the NICT{'}s participation (team ID: NICT) in the 6th Workshop on Asian Translation (WAT-2019) shared translation task, specifically Myanmar (Burmese) - English task in both translation directions. We…

Language ModelingLanguage ModellingMachine TranslationNMT+1

Supervised and Unsupervised Machine Translation for Myanmar-English and Khmer-English

2019-11-01 · WS 2019 11 · Benjamin Marie, Hour Kaing, Aye Myat Mon, Chenchen Ding 외

This paper presents the NICT{'}s supervised and unsupervised machine translation systems for the WAT2019 Myanmar-English and Khmer-English translation tasks. For all the translation directions, we built state-of-the-art …

Machine TranslationNMTTranslationUnsupervised Machine Translation

NICT's Machine Translation Systems for the WMT19 Similar Language Translation Task

2019-08-01 · WS 2019 8 · Benjamin Marie, Raj Dabre, Atsushi Fujita

This paper presents the NICT{'}s participation in the WMT19 shared Similar Language Translation Task. We participated in the Spanish-Portuguese task. For both translation directions, we prepared state-of-the-art statisti…

Machine TranslationNMTTranslation