Modeling Coverage for Neural Machine Translation
Attention mechanism has enhanced state-of-the-art Neural Machine Translation (NMT) by jointly learning to align and translate. It tends to ignore past alignment information, however, which often leads to over-translation and under-translation. To address this problem, we propose coverage-based NMT in this paper. We maintain a coverage vector to keep track of the attention history. The coverage vector is fed to the attention model to help adjust future attention, which lets NMT system to consider more about untranslated source words. Experiments show that the proposed approach significantly improves both translation quality and alignment quality over standard attention-based NMT.
Code (3)
Tasks
Machine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Modeling Coverage for Non-Autoregressive Neural Machine Translation
Non-Autoregressive Neural Machine Translation (NAT) has achieved significant inference speedup by generating all tokens simultaneously. Despite its high efficiency, NAT usually suffers from two kinds of translation error…
Machine TranslationSentenceTranslationCoverage Embedding Models for Neural Machine Translation
In this paper, we enhance the attention-based neural machine translation (NMT) by adding explicit coverage embedding models to alleviate issues of repeating and dropping translations in NMT. For each source word, our mod…
Machine TranslationNMTTranslationModeling Past and Future for Neural Machine Translation
Existing neural machine translation systems do not explicitly model what has been translated and what has not during the decoding phase. To address this problem, we propose a novel mechanism that separates the source inf…
DecoderMachine TranslationNMTTranslationOn the Language Coverage Bias for Neural Machine Translation
Language coverage bias, which indicates the content-dependent differences between sentence pairs originating from the source and target languages, is important for neural machine translation (NMT) because the target-orig…
Data AugmentationMachine TranslationNMTSentence+1Optimizing example selection for retrieval-augmented machine translation with translation memories
Retrieval-augmented machine translation leverages examples from a translation memory by retrieving similar instances. These examples are used to condition the predictions of a neural decoder. We aim to improve the upstre…
DecoderMachine TranslationRetrievalSentence+1