Training Neural Machine Translation To Apply Terminology Constraints
This paper proposes a novel method to inject custom terminology into neural machine translation at run time. Previous works have mainly proposed modifications to the decoding algorithm in order to constrain the output to include run-time-provided target terms. While being effective, these constrained decoding methods add, however, significant computational overhead to the inference step, and, as we show in this paper, can be brittle when tested in realistic conditions. In this paper we approach the problem by training a neural MT system to learn how to use custom terminology when provided with the input. Comparative experiments show that our method is not only more effective than a state-of-the-art implementation of constrained decoding, but is also as fast as constraint-free decoding.
Code (1)
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Cascaded Beam Search: Plug-and-Play Terminology-Forcing For Neural Machine Translation
This paper presents a plug-and-play approach for translation with terminology constraints. Terminology constraints are an important aspect of many modern translation pipelines. In both specialized domains and newly emerg…
Language ModelingLanguage ModellingMachine TranslationSentence+1Neural Machine Translation Decoding with Terminology Constraints
Despite the impressive quality improvements yielded by neural machine translation (NMT) systems, controlling their translation output to adhere to user-provided terminology constraints remains an open problem. We describ…
Machine TranslationNMTTranslationTerminology-Aware Translation with Constrained Decoding and Large Language Model Prompting
Terminology correctness is important in the downstream application of machine translation, and a prevalent way to ensure this is to inject terminology constraints into a translation system. In our submission to the WMT 2…
Language ModelingLanguage ModellingLarge Language ModelMachine Translation+2TermMind: Alibaba’s WMT21 Machine Translation Using Terminologies Task Submission
This paper describes our work in the WMT 2021 Machine Translation using Terminologies Shared Task. We participate in the shared translation terminologies task in English to Chinese language pair. To satisfy terminology c…
Data AugmentationMachine TranslationTranslationKakao Enterprise’s WMT21 Machine Translation Using Terminologies Task Submission
This paper describes Kakao Enterprise’s submission to the WMT21 shared Machine Translation using Terminologies task. We integrate terminology constraints by pre-training with target lemma annotations and fine-tuning with…
LEMMAMachine TranslationTranslation