Multiword Expression aware Neural Machine Translation
Multiword Expressions (MWEs) are a frequently occurring phenomenon found in all natural languages that is of great importance to linguistic theory, natural language processing applications, and machine translation systems. Neural Machine Translation (NMT) architectures do not handle these expressions well and previous studies have rarely addressed MWEs in this framework. In this work, we show that annotation and data augmentation, using external linguistic resources, can improve both translation of MWEs that occur in the source, and the generation of MWEs on the target, and increase performance by up to 5.09 BLEU points on MWE test sets. We also devise a MWE score to specifically assess the quality of MWE translation which agrees with human evaluation. We make available the MWE score implementation {--} along with MWE-annotated training sets and corpus-based lists of MWEs {--} for reproduction and extension.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationMachine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Evaluating the Impact of Verbal Multiword Expressions on Machine Translation
Verbal multiword expressions (VMWEs) remain difficult for machine translation because their meanings are often not recoverable from their component words. In this study, we analyze the impact of three VMWE categories -- …
Machine TranslationMultiword Expressions in the Context of Statistical Machine Translation
The Impact of Multiword Expression Compositionality on Machine Translation Evaluation
Detecting Unseen Multiword Expressions in American Sign Language
Multiword expressions present unique challenges in many translation tasks. In an attempt to ultimately apply a multiword expression detection system to the translation of American Sign Language, we built and tested two s…
TranslationWord Embeddings