Application of Low-resource Machine Translation Techniques to Russian-Tatar Language Pair

2019-10-01 · Aidar Valeev, Ilshat Gibadullin, Albina Khusainova, Adil Khan

Neural machine translation is the current state-of-the-art in machine translation. Although it is successful in a resource-rich setting, its applicability for low-resource language pairs is still debatable. In this paper, we explore the effect of different techniques to improve machine translation quality when a parallel corpus is as small as 324 000 sentences, taking as an example previously unexplored Russian-Tatar language pair. We apply such techniques as transfer learning and semi-supervised learning to the base Transformer model, and empirically show that the resulting models improve Russian to Tatar and Tatar to Russian translation quality by +2.57 and +3.66 BLEU, respectively.

📄 PDF Abstract BibTeX arXiv:1910.00368

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Translation Transfer Learning Translation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Residual Connection 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

DUTNLP Machine Translation System for WMT21 Triangular Translation Task

2021-11-01 · WMT (EMNLP) 2021 11 · Huan Liu, Junpeng Liu, Kaiyu Huang, Degen Huang

This paper describes DUT-NLP Lab’s submission to the WMT-21 triangular machine translation shared task. The participants are not allowed to use other data and the translation direction of this task is Russian-to-Chinese.…

Machine Translation Translation

The TALP-UPC Machine Translation Systems for WMT19 News Translation Task: Pivoting Techniques for Low Resource MT

2019-08-01 · WS 2019 8 · Noe Casas, Jos{\'e} A. R. Fonollosa, Carlos Escolano, Christine Basta 외

In this article, we describe the TALP-UPC research group participation in the WMT19 news translation shared task for Kazakh-English. Given the low amount of parallel training data, we resort to using Russian as pivot lan…

Decoder Machine Translation Translation

Low-resource Machine Translation for Code-switched Kazakh-Russian Language Pair

2025-03-25 · Maksim Borisov, Zhanibek Kozhirbayev, Valentin Malykh

Machine translation for low resource language pairs is a challenging task. This task could become extremely difficult once a speaker uses code switching. We propose a method to build a machine translation model for code-…

Machine Translation Translation

Japanese-Russian TMU Neural Machine Translation System using Multilingual Model for WAT 2019

2019-11-01 · WS 2019 11 · Aizhan Imankulova, Masahiro Kaneko, Mamoru Komachi

We introduce our system that is submitted to the News Commentary task (Japanese{\textless}-{\textgreater}Russian) of the 6th Workshop on Asian Translation. The goal of this shared task is to study extremely low resource …

Machine Translation NMT Translation

Pivot Based Transfer Learning for Neural Machine Translation: CFILT IITB @ WMT 2021 Triangular MT

2021-11-01 · WMT (EMNLP) 2021 11 · Shivam Mhaskar, Pushpak Bhattacharyya

In this paper, we discuss the various techniques that we used to implement the Russian-Chinese machine translation system for the Triangular MT task at WMT 2021. Neural Machine translation systems based on transformer ar…

Decoder Machine Translation Transfer Learning Translation