Transformer-based Automatic Post-Editing Model with Joint Encoder and Multi-source Attention of Decoder
This paper describes POSTECH{'}s submission to the WMT 2019 shared task on Automatic Post-Editing (APE). In this paper, we propose a new multi-source APE model by extending Transformer. The main contributions of our study are that we 1) reconstruct the encoder to generate a joint representation of translation (mt) and its src context, in addition to the conventional src encoding and 2) suggest two types of multi-source attention layers to compute attention between two outputs of the encoder and the decoder state in the decoder. Furthermore, we train our model by applying various teacher-forcing ratios to alleviate exposure bias. Finally, we adopt the ensemble technique across variations of our model. Experiments on the WMT19 English-German APE data set show improvements in terms of both TER and BLEU scores over the baseline. Our primary submission achieves -0.73 in TER and +1.49 in BLEU compare to the baseline.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Post-EditingDecoderTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Transformer-Based Multi-Source Automatic Post-Editing System
This paper presents our English{--}German Automatic Post-Editing (APE) system submitted to the APE Task organized at WMT 2018 (Chatterjee et al., 2018). The proposed model is an extension of the transformer architecture:…
Automatic Post-EditingMachine TranslationNMTSentence+1Multi-encoder Transformer Network for Automatic Post-Editing
This paper describes the POSTECH{'}s submission to the WMT 2018 shared task on Automatic Post-Editing (APE). We propose a new neural end-to-end post-editing model based on the transformer network. We modified the encoder…
Automatic Post-EditingDecoderMachine TranslationNMT+1UdS Submission for the WMT 19 Automatic Post-Editing Task
In this paper, we describe our submission to the English-German APE shared task at WMT 2019. We utilize and adapt an NMT architecture originally developed for exploiting context information to APE, implement this in our …
Automatic Post-EditingNMTUSAAR-DFKI -- The Transference Architecture for English--German Automatic Post-Editing
In this paper we present an English{--}German Automatic Post-Editing (APE) system called transference, submitted to the APE Task organized at WMT 2019. Our transference model is based on a multi-encoder transformer archi…
Automatic Post-EditingDecoderMachine TranslationTranslationTransformer-based Automatic Post-Editing with a Context-Aware Encoding Approach for Multi-Source Inputs
Recent approaches to the Automatic Post-Editing (APE) research have shown that better results are obtained by multi-source models, which jointly encode both source (src) and machine translation output (mt) to produce pos…
Automatic Post-EditingMachine TranslationSentenceTranslation+1