An Exploration of Neural Sequence-to-Sequence Architectures for Automatic Post-Editing
In this work, we explore multiple neural architectures adapted for the task of automatic post-editing of machine translation output. We focus on neural end-to-end models that combine both inputs $mt$ (raw MT output) and $src$ (source language input) in a single neural architecture, modeling $\{mt, src\} \rightarrow pe$ directly. Apart from that, we investigate the influence of hard-attention models which seem to be well-suited for monolingual tasks, as well as combinations of both ideas. We report results on data sets provided during the WMT-2016 shared task on automatic post-editing and can demonstrate that dual-attention models that incorporate all available data in the APE scenario in a single model improve on the best shared task system and on all other published results after the shared task. Dual-attention models that are combined with hard attention remain competitive despite applying fewer changes to the input.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Post-EditingHard AttentionMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Posterior Attention Models for Sequence to Sequence Learning
Modern neural architectures critically rely on attention for mapping structured inputs to sequences. In this paper we show that prevalent attention architectures do not adequately model the dependence among the attention…
Morphological InflectionPositionTranslationComparison of different automatic solutions for resection cavity segmentation in postoperative MRI volumes including longitudinal acquisitions
In this work, we compare five deep learning solutions to automatically segment the resection cavity in postoperative MRI. The proposed methods are based on the same 3D U-Net architecture. We use a dataset of postoperativ…
DEEPGONET: Multi-label Prediction of GO Annotation for Protein from Sequence Using Cascaded Convolutional and Recurrent Network
The present gap between the amount of available protein sequence due to the development of next generation sequencing technology (NGS) and slow and expensive experimental extraction of useful information like annotation …
Efficient ExplorationDynE: Dynamic Ensemble Decoding for Multi-Document Summarization
Sequence-to-sequence (s2s) models are the basis for extensive work in natural language processing. However, some applications, such as multi-document summarization, multi-modal machine translation, and the automatic post…
ArticlesAutomatic Post-EditingDocument SummarizationMachine Translation+2CUNI System for WMT16 Automatic Post-Editing and Multimodal Translation Tasks
Neural sequence to sequence learning recently became a very promising paradigm in machine translation, achieving competitive results with statistical phrase-based systems. In this system description paper, we attempt to …
Automatic Post-EditingMachine TranslationMultimodal Machine TranslationTranslation