paper-with-me

Papers

Guiding Non-Autoregressive Neural Machine Translation Decoding with Reordering Information

2019-11-06 · Qiu Ran, Yankai Lin, Peng Li, Jie zhou

Non-autoregressive neural machine translation (NAT) generates each target word in parallel and has achieved promising inference acceleration. However, existing NAT models still have a big gap in translation quality compared to autoregressive neural machine translation models due to the enormous decoding space. To address this problem, we propose a novel NAT framework named ReorderNAT which explicitly models the reordering information in the decoding procedure. We further introduce deterministic and non-deterministic decoding strategies that utilize reordering information to narrow the decoding search space in our proposed ReorderNAT. Experimental results on various widely-used datasets show that our proposed model achieves better performance compared to existing NAT models, and even achieves comparable translation quality as autoregressive translation models with a significant speedup.

📄 PDF Abstract BibTeX arXiv:1911.02215

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationTranslation

Similar Papers 제목 키워드 기반

Non-Monotonic Latent Alignments for CTC-Based Non-Autoregressive Machine Translation

2022-10-08 · Chenze Shao, Yang Feng

Non-autoregressive translation (NAT) models are typically trained with the cross-entropy loss, which forces the model outputs to be aligned verbatim with the target sentence and will highly penalize small shifts in word …

Machine TranslationSentenceTranslation

Phrase-based Machine Translation using Multiple Preordering Candidates

2016-12-01 · COLING 2016 12 · Yusuke Oda, Taku Kudo, Tetsuji Nakagawa, Taro Watanabe

In this paper, we propose a new decoding method for phrase-based statistical machine translation which directly uses multiple preordering candidates as a graph structure. Compared with previous phrase-based decoding meth…

DecoderMachine TranslationTranslation

Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT

2021-09-03 · EMNLP 2021 11 · Elena Voita, Rico Sennrich, Ivan Titov

Differently from the traditional statistical MT that decomposes the translation task into distinct separately learned components, neural machine translation uses a single neural network to model the entire translation pr…

Language ModelingLanguage ModellingMachine TranslationModel Selection+3

Rule-based Reordering Space in Statistical Machine Translation

2014-05-01 · LREC 2014 5 · Nicolas P{\'e}cheux, Alex Allauzen, er, Fran{\c{c}}ois Yvon

In Statistical Machine Translation (SMT), the constraints on word reorderings have a great impact on the set of potential translations that are explored. Notwithstanding computationnal issues, the reordering space of a S…

Machine TranslationTranslation

Reordering rules for English-Hindi SMT

2016-10-24 · WS 2013 8 · Raj Nath Patel, Rohit Gupta, Prakash B. Pimpale, Sasikumar M

Reordering is a preprocessing stage for Statistical Machine Translation (SMT) system where the words of the source sentence are reordered as per the syntax of the target language. We are proposing a rich set of rules for…

Machine TranslationPositionSentenceTranslation