paper-with-me

홈 › Papers

Transformer-based Automatic Post-Editing with a Context-Aware Encoding Approach for Multi-Source Inputs

2019-08-15 · WonKee Lee, Junsu Park, Byung-Hyun Go, Jong-Hyeok Lee

Recent approaches to the Automatic Post-Editing (APE) research have shown that better results are obtained by multi-source models, which jointly encode both source (src) and machine translation output (mt) to produce post-edited sentence (pe). Along this trend, we present a new multi-source APE model based on the Transformer. To construct effective joint representations, our model internally learns to incorporate src context into mt representation. With this approach, we achieve a significant improvement over baseline systems, as well as the state-of-the-art multi-source APE model. Moreover, to demonstrate the capability of our model to incorporate src context, we show that the word alignment of the unknown MT system is successfully captured in our encoding results.

📄 PDF Abstract BibTeX arXiv:1908.05679

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Post-EditingMachine TranslationSentenceTranslationWord Alignment

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Adam 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Exploring the Importance of Source Text in Automatic Post-Editing for Context-Aware Machine Translation

2021-05-01 · NoDaLiDa 2021 5 · Chaojun Wang, Christian Hardmeier, Rico Sennrich

Accurate translation requires document-level information, which is ignored by sentence-level machine translation. Recent work has demonstrated that document-level consistency can be improved with automatic post-editing (…

Automatic Post-EditingMachine TranslationSentenceTranslation

Multi-encoder Transformer Network for Automatic Post-Editing

2018-10-01 · WS 2018 10 · Jaehun Shin, Jong-Hyeok Lee

This paper describes the POSTECH{'}s submission to the WMT 2018 shared task on Automatic Post-Editing (APE). We propose a new neural end-to-end post-editing model based on the transformer network. We modified the encoder…

Automatic Post-EditingDecoderMachine TranslationNMT+1

Transformer-based Automatic Post-Editing Model with Joint Encoder and Multi-source Attention of Decoder

2019-08-01 · WS 2019 8 · WonKee Lee, Jaehun Shin, Jong-Hyeok Lee

This paper describes POSTECH{'}s submission to the WMT 2019 shared task on Automatic Post-Editing (APE). In this paper, we propose a new multi-source APE model by extending Transformer. The main contributions of our stud…

Automatic Post-EditingDecoderTranslation

UdS Submission for the WMT 19 Automatic Post-Editing Task

2019-08-09 · WS 2019 8 · Hongfei Xu, Qiuhui Liu, Josef van Genabith

In this paper, we describe our submission to the English-German APE shared task at WMT 2019. We utilize and adapt an NMT architecture originally developed for exploiting context information to APE, implement this in our …

Automatic Post-EditingNMT

MS-UEdin Submission to the WMT2018 APE Shared Task: Dual-Source Transformer for Automatic Post-Editing

2018-09-01 · WS 2018 10 · Marcin Junczys-Dowmunt, Roman Grundkiewicz

This paper describes the Microsoft and University of Edinburgh submission to the Automatic Post-editing shared task at WMT2018. Based on training data and systems from the WMT2017 shared task, we re-implement our own mod…

Automatic Post-EditingNMT