Multi-encoder Transformer Network for Automatic Post-Editing

2018-10-01 · WS 2018 10 · Jaehun Shin, Jong-Hyeok Lee

This paper describes the POSTECH{'}s submission to the WMT 2018 shared task on Automatic Post-Editing (APE). We propose a new neural end-to-end post-editing model based on the transformer network. We modified the encoder-decoder attention to reflect the relation between the machine translation output, the source and the post-edited translation in APE problem. Experiments on WMT17 English-German APE data set show an improvement in both TER and BLEU score over the best result of WMT17 APE shared task. Our primary submission achieves -4.52 TER and +6.81 BLEU score on PBSMT task and -0.13 TER and +0.40 BLEU score for NMT task compare to the baseline.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Post-EditingDecoder Machine TranslationNMTTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Residual Connection 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

A Transformer-Based Multi-Source Automatic Post-Editing System

2018-10-01 · WS 2018 10 · Santanu Pal, Nico Herbig, Antonio Kr{\"u}ger, Josef van Genabith

This paper presents our English{--}German Automatic Post-Editing (APE) system submitted to the APE Task organized at WMT 2018 (Chatterjee et al., 2018). The proposed model is an extension of the transformer architecture:…

Automatic Post-Editing Machine Translation NMT Sentence+1

USAAR-DFKI -- The Transference Architecture for English--German Automatic Post-Editing

2019-08-01 · WS 2019 8 · Santanu Pal, Hongfei Xu, Nico Herbig, Antonio Kr{\"u}ger 외

In this paper we present an English{--}German Automatic Post-Editing (APE) system called transference, submitted to the APE Task organized at WMT 2019. Our transference model is based on a multi-encoder transformer archi…

Automatic Post-Editing Decoder Machine Translation Translation

Transformer-based Automatic Post-Editing Model with Joint Encoder and Multi-source Attention of Decoder

2019-08-01 · WS 2019 8 · WonKee Lee, Jaehun Shin, Jong-Hyeok Lee

This paper describes POSTECH{'}s submission to the WMT 2019 shared task on Automatic Post-Editing (APE). In this paper, we propose a new multi-source APE model by extending Transformer. The main contributions of our stud…

Automatic Post-Editing Decoder Translation

The Transference Architecture for Automatic Post-Editing

2019-08-16 · COLING 2020 8 · Santanu Pal, Hongfei Xu, Nico Herbig, Sudip Kumar Naskar 외

In automatic post-editing (APE) it makes sense to condition post-editing (pe) decisions on both the source (src) and the machine translated text (mt) as input. This has led to multi-source encoder based APE approaches. A…

Automatic Post-Editing Decoder NMT

UdS Submission for the WMT 19 Automatic Post-Editing Task

2019-08-09 · WS 2019 8 · Hongfei Xu, Qiuhui Liu, Josef van Genabith

In this paper, we describe our submission to the English-German APE shared task at WMT 2019. We utilize and adapt an NMT architecture originally developed for exploiting context information to APE, implement this in our …

Automatic Post-Editing NMT