paper-with-me

Papers

The RWTH Aachen University Supervised Machine Translation Systems for WMT 2018

2018-10-01 · WS 2018 10 · Julian Schamper, Jan Rosendahl, Parnia Bahar, Yunsu Kim, Arne Nix, Hermann Ney

This paper describes the statistical machine translation systems developed at RWTH Aachen University for the German→English, English→Turkish and Chinese→English translation tasks of the EMNLP 2018 Third Conference on Machine Translation (WMT 2018). We use ensembles of neural machine translation systems based on the Transformer architecture. Our main focus is on the German→English task where we to all automatic scored first with respect metrics provided by the organizers. We identify data selection, fine-tuning, batch size and model dimension as important hyperparameters. In total we improve by 6.8{\%} BLEU over our last year{'}s submission and by 4.8{\%} BLEU over the winning system of the 2017 German→English task. In English→Turkish task, we show 3.6{\%} BLEU improvement over the last year{'}s winning system. We further report results on the Chinese→English task where we improve 2.2{\%} BLEU on average over our baseline systems but stay behind the 2018 winning systems.

📄 PDF Abstract BibTeX

Code (1)

awslabs/sockeye 공식 구현 mxnet

Tasks

Machine TranslationTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

The RWTH Aachen University English-German and German-English Unsupervised Neural Machine Translation Systems for WMT 2018

2018-10-01 · WS 2018 10 · Miguel Gra{\c{c}}a, Yunsu Kim, Julian Schamper, Jiahui Geng 외

This paper describes the unsupervised neural machine translation (NMT) systems of the RWTH Aachen University developed for the English ↔ German news translation task of the \textit{EMNLP 2018 Third Conference on Machin…

DecoderMachine TranslationNMTTranslation+1

The RWTH Aachen University English-Romanian Machine Translation System for WMT 2016

2016-08-01 · WS 2016 8 · Jan-Thorsten Peter, Tamer Alkhouli, Andreas Guta, Hermann Ney
Language ModelingLanguage ModellingMachine TranslationTranslation

The RWTH Aachen University English-German and German-English Machine Translation System for WMT 2017

2017-09-01 · WS 2017 9 · Jan-Thorsten Peter, Andreas Guta, Tamer Alkhouli, Parnia Bahar 외
Machine TranslationTranslation

The RWTH Aachen Machine Translation Systems for IWSLT 2017

2017-12-01 · IWSLT 2017 12 · Parnia Bahar, Jan Rosendahl, Nick Rossenbach, Hermann Ney

This work describes the Neural Machine Translation (NMT) system of the RWTH Aachen University developed for the English$German tracks of the evaluation campaign of the International Workshop on Spoken Language Translatio…

Domain AdaptationMachine TranslationNMTTranslation

The RWTH Aachen Machine Translation System for IWSLT 2016

2016-12-01 · IWSLT 2016 12 · Jan-Thorsten Peter, Andreas Guta, Nick Rossenbach, Miguel Graça 외

This work describes the statistical machine translation (SMT) systems of RWTH Aachen University developed for the evaluation campaign of International Workshop on Spoken Language Translation (IWSLT) 2016. We have partici…

DecoderMachine TranslationRerankingTranslation