CUNI Submission for Low-Resource Languages in WMT News 2019

2019-08-01 · WS 2019 8 · Tom Kocmi, Ond{\v{r}}ej Bojar

This paper describes the CUNI submission to the WMT 2019 News Translation Shared Task for the low-resource languages: Gujarati-English and Kazakh-English. We participated in both language pairs in both translation directions. Our system combines transfer learning from a different high-resource language pair followed by training on backtranslated monolingual data. Thanks to the simultaneous training in both directions, we can iterate the backtranslation process. We are using the Transformer model in a constrained submission.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer Learning Translation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Residual Connection 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

CUNI Submission for the Inuktitut Language in WMT News 2020

2020-11-01 · WMT (EMNLP) 2020 11 · Tom Kocmi

This paper describes CUNI submission to the WMT 2020 News Translation Shared Task for the low-resource scenario Inuktitut–English in both translation directions. Our system combines transfer learning from a Czech–English…

Transfer Learning Translation

CUNI x-ling: Parsing Under-Resourced Languages in CoNLL 2018 UD Shared Task

2018-10-01 · CONLL 2018 10 · Rudolf Rosa, David Mare{\v{c}}ek

This is a system description paper for the CUNI x-ling submission to the CoNLL 2018 UD Shared Task. We focused on parsing under-resourced languages, with no or little training data available. We employed a wide range of …

Translation

CUNI System for the WMT19 Robustness Task

2019-06-21 · WS 2019 8 · Jindřich Helcl, Jindřich Libovický, Martin Popel

We present our submission to the WMT19 Robustness Task. Our baseline system is the Charles University (CUNI) Transformer system trained for the WMT18 shared task on News Translation. Quantitative results show that the CU…

Translation

CUNI Submissions in WMT18

2018-10-01 · WS 2018 10 · Tom Kocmi, Roman Sudarikov, Ond{\v{r}}ej Bojar

We participated in the WMT 2018 shared news translation task in three language pairs: English-Estonian, English-Finnish, and English-Czech. Our main focus was the low-resource language pair of Estonian and English for wh…

Machine Translation Translation

CUNI systems for WMT21: Multilingual Low-Resource Translation for Indo-European Languages Shared Task

2021-09-20 · WMT (EMNLP) 2021 11 · Josef Jon, Michal Novák, João Paulo Aires, Dušan Variš 외

This paper describes Charles University submission for Multilingual Low-Resource Translation for Indo-European Languages shared task at WMT21. We competed in translation from Catalan into Romanian, Italian and Occitan. O…

Grapheme-to-Phoneme Conversion Multi-Task Learning Translation