paper-with-me

홈 › Papers

Chunk-based Decoder for Neural Machine Translation

2017-07-01 · ACL 2017 7 · Shonosuke Ishiwatari, JingTao Yao, Shujie Liu, Mu Li, Ming Zhou, Naoki Yoshinaga, Masaru Kitsuregawa, Weijia Jia

Chunks (or phrases) once played a pivotal role in machine translation. By using a chunk rather than a word as the basic translation unit, local (intra-chunk) and global (inter-chunk) word orders and dependencies can be easily modeled. The chunk structure, despite its importance, has not been considered in the decoders used for neural machine translation (NMT). In this paper, we propose chunk-based decoders for (NMT), each of which consists of a chunk-level decoder and a word-level decoder. The chunk-level decoder models global dependencies while the word-level decoder decides the local word order in a chunk. To output a target sentence, the chunk-level decoder generates a chunk representation containing global information, which the word-level decoder then uses as a basis to predict the words inside the chunk. Experimental results show that our proposed decoders can significantly improve translation performance in a WAT {`}16 English-to-Japanese translation task.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderMachine TranslationNMTSentenceTranslation

Similar Papers 제목 키워드 기반

Chunk-Based Bi-Scale Decoder for Neural Machine Translation

2017-05-03 · ACL 2017 7 · Hao Zhou, Zhaopeng Tu, Shu-Jian Huang, Xiaohua Liu 외

In typical neural machine translation~(NMT), the decoder generates a sentence word by word, packing all linguistic granularities in the same time-scale of RNN. In this paper, we propose a new type of decoder for NMT, whi…

DecoderMachine TranslationNMTSentence+1

Neural Machine Translation Incorporating Named Entity

2018-08-01 · COLING 2018 8 · Arata Ugawa, Akihiro Tamura, Takashi Ninomiya, Hiroya Takamura 외

This study proposes a new neural machine translation (NMT) model based on the encoder-decoder model that incorporates named entity (NE) tags of source-language sentences. Conventional NMT models have two problems enumera…

DecoderMachine TranslationNMTSentence+2

Syntax-based Multi-system Machine Translation

2016-05-01 · LREC 2016 5 · Mat{\=\i}ss Rikters, Inguna Skadi{\c{n}}a

This paper describes a hybrid machine translation system that explores a parser to acquire syntactic chunks of a source sentence, translates the chunks with multiple online machine translation (MT) system application pro…

Language ModelingLanguage ModellingMachine TranslationSentence+1

Learning from Chunk-based Feedback in Neural Machine Translation

2018-06-19 · ACL 2018 7 · Pavel Petrushkov, Shahram Khadivi, Evgeny Matusov

We empirically investigate learning from partial feedback in neural machine translation (NMT), when partial feedback is collected by asking users to highlight a correct chunk of a translation. We propose a simple and eff…

Machine TranslationNMTSentenceTranslation

Syntactically Supervised Transformers for Faster Neural Machine Translation

2019-06-06 · ACL 2019 7 · Nader Akoury, Kalpesh Krishna, Mohit Iyyer

Standard decoders for neural machine translation autoregressively generate a single target token per time step, which slows inference especially for long outputs. While architectural advances such as the Transformer full…

DecoderMachine TranslationTranslation