Supervised neural machine translation based on data augmentation and improved training \& inference process

2019-11-01 · WS 2019 11 · Yixuan Tong, Liang Liang, Boyan Liu, Shanshan Jiang, Bin Dong

This is the second time for SRCB to participate in WAT. This paper describes the neural machine translation systems for the shared translation tasks of WAT 2019. We participated in ASPEC tasks and submitted results on English-Japanese, Japanese-English, Chinese-Japanese, and Japanese-Chinese four language pairs. We employed the Transformer model as the baseline and experimented relative position representation, data augmentation, deep layer model, ensemble. Experiments show that all these methods can yield substantial improvements.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation Machine TranslationPositionTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Residual Connection 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Improved Data Augmentation for Translation Suggestion

2022-10-12 · Hongxiao Zhang, Siyu Lai, Songming Zhang, Hui Huang 외

Translation suggestion (TS) models are used to automatically provide alternative suggestions for incorrect spans in sentences generated by machine translation. This paper introduces the system used in our submission to t…

Data Augmentation Machine Translation Translation

Generalized Data Augmentation for Low-Resource Translation

2019-06-10 · ACL 2019 7 · Mengzhou Xia, Xiang Kong, Antonios Anastasopoulos, Graham Neubig

Translation to or from low-resource languages LRLs poses challenges for machine translation in terms of both adequacy and fluency. Data augmentation utilizing large amounts of monolingual data is regarded as an effective…

Data Augmentation Machine Translation Translation Unsupervised Machine Translation

Sentence Concatenation Approach to Data Augmentation for Neural Machine Translation

2021-04-17 · NAACL 2021 4 · Seiichiro Kondo, Kengo Hotate, Masahiro Kaneko, Mamoru Komachi

Neural machine translation (NMT) has recently gained widespread attention because of its high translation accuracy. However, it shows poor performance in the translation of long sentences, which is a major issue in low-r…

Data Augmentation Machine Translation NMT Sentence+1

Data Augmentation and Terminology Integration for Domain-Specific Sinhala-English-Tamil Statistical Machine Translation

2020-11-05 · Aloka Fernando, Surangika Ranathunga, Gihan Dias

Out of vocabulary (OOV) is a problem in the context of Machine Translation (MT) in low-resourced languages. When source and/or target languages are morphologically rich, it becomes even worse. Bilingual list integration …

Data Augmentation Machine Translation Translation

Unsupervised Paraphrasing without Translation

2019-05-29 · ACL 2019 7 · Aurko Roy, David Grangier

Paraphrasing exemplifies the ability to abstract semantic content from surface forms. Recent work on automatic paraphrasing is dominated by methods leveraging Machine Translation (MT) as an intermediate step. This contra…

Machine Translation Paraphrase Identification Translation