Guiding Neural Machine Translation with Retrieved Translation Pieces
One of the difficulties of neural machine translation (NMT) is the recall and appropriate translation of low-frequency words or phrases. In this paper, we propose a simple, fast, and effective method for recalling previously seen translation examples and incorporating them into the NMT decoding process. Specifically, for an input sentence, we use a search engine to retrieve sentence pairs whose source sides are similar with the input sentence, and then collect $n$-grams that are both in the retrieved target sentences and aligned with words that match in the source sentences, which we call "translation pieces". We compute pseudo-probabilities for each retrieved sentence based on similarities between the input sentence and the retrieved source sentences, and use these to weight the retrieved translation pieces. Finally, an existing NMT model is used to translate the input sentence, with an additional bonus given to outputs that contain the collected translation pieces. We show our method improves NMT translation results up to 6 BLEU points on three narrow domain translation tasks where repetitiveness of the target sentences is particularly salient. It also causes little increase in the translation time, and compares favorably to another alternative retrieval-based method with respect to accuracy, speed, and simplicity of implementation.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTRetrievalSentenceTranslationSimilar Papers 제목 키워드 기반
Neural Machine Translation with Contrastive Translation Memories
Retrieval-augmented Neural Machine Translation models have been successful in many translation scenarios. Different from previous works that make use of mutually similar but redundant translation memories~(TMs), we propo…
Contrastive LearningMachine TranslationNMTRetrieval+2Improving Domain Adaptation for Machine Translation withTranslation Pieces
Learning Kernel-Smoothed Machine Translation with Retrieved Examples
How to effectively adapt neural machine translation (NMT) models according to emerging cases without retraining? Despite the great success of neural machine translation, updating the deployed models online remains a chal…
Domain AdaptationMachine TranslationNMTRetrieval+1Zero-shot Domain Adaptation for Neural Machine Translation with Retrieved Phrase-level Prompts
Domain adaptation is an important challenge for neural machine translation. However, the traditional fine-tuning solution requires multiple extra training and yields a high cost. In this paper, we propose a non-tuning pa…
Domain AdaptationMachine TranslationTranslationLearning to Rewrite for Non-Autoregressive Neural Machine Translation
Non-autoregressive neural machine translation, which decomposes the dependence on previous target tokens from the inputs of the decoder, has achieved impressive inference speedup but at the cost of inferior accuracy. Pre…
Decoderde-enMachine TranslationTranslation