Understanding and Improving Morphological Learning in the Neural Machine Translation Decoder
End-to-end training makes the neural machine translation (NMT) architecture simpler, yet elegant compared to traditional statistical machine translation (SMT). However, little is known about linguistic patterns of morphology, syntax and semantics learned during the training of NMT systems, and more importantly, which parts of the architecture are responsible for learning each of these phenomenon. In this paper we i) analyze how much morphology an NMT decoder learns, and ii) investigate whether injecting target morphology in the decoder helps it to produce better translations. To this end we present three methods: i) simultaneous translation, ii) joint-data learning, and iii) multi-task learning. Our results show that explicit morphological information helps the decoder learn target language morphology and improves the translation quality by 0.2{--}0.6 BLEU points.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderMachine TranslationMulti-Task LearningNMTTranslationSimilar Papers 제목 키워드 기반
Character-Aware Decoder for Translation into Morphologically Rich Languages
Neural machine translation (NMT) systems operate primarily on words (or sub-words), ignoring lower-level patterns of morphology. We present a character-aware decoder designed to capture such patterns when translating int…
DecoderMachine TranslationNMTTranslationImproving the Performance of Neural Machine Translation Involving Morphologically Rich Languages
The advent of the attention mechanism in neural machine translation models has improved the performance of machine translation systems by enabling selective lookup into the source sentence. In this paper, the efficiencie…
DecoderMachine TranslationSentenceTranslationLow-resource neural machine translation with morphological modeling
Morphological modeling in neural machine translation (NMT) is a promising approach to achieving open-vocabulary machine translation for morphologically-rich languages. However, existing methods such as sub-word tokenizat…
Data AugmentationDecoderLow Resource Neural Machine TranslationLow-Resource Neural Machine Translation+4Improving Character-based Decoding Using Target-Side Morphological Information for Neural Machine Translation
Recently, neural machine translation (NMT) has emerged as a powerful alternative to conventional statistical approaches. However, its performance drops considerably in the presence of morphologically rich languages (MRLs…
DecoderMachine TranslationNMTTranslationImproving Neural Text Normalization with Data Augmentation at Character- and Morphological Levels
In this study, we investigated the effectiveness of augmented data for encoder-decoder-based neural normalization models. Attention based encoder-decoder models are greatly effective in generating many natural languages.…
Data AugmentationDecoderMachine TranslationText Normalization+2