Improving Retrieval Augmented Neural Machine Translation by Controlling Source and Fuzzy-Match Interactions
We explore zero-shot adaptation, where a general-domain model has access to customer or domain specific parallel data at inference time, but not during training. We build on the idea of Retrieval Augmented Translation (RAT) where top-k in-domain fuzzy matches are found for the source sentence, and target-language translations of those fuzzy-matched sentences are provided to the translation model at inference time. We propose a novel architecture to control interactions between a source sentence and the top-k fuzzy target-language matches, and compare it to architectures from prior work. We conduct experiments in two language pairs (En-De and En-Fr) by training models on WMT data and testing them with five and seven multi-domain datasets, respectively. Our approach consistently outperforms the alternative architectures, improving BLEU across language pair, domain, and number k of fuzzy matches.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationRetrievalSentenceTranslationSimilar Papers 제목 키워드 기반
Optimizing example selection for retrieval-augmented machine translation with translation memories
Retrieval-augmented machine translation leverages examples from a translation memory by retrieving similar instances. These examples are used to condition the predictions of a neural decoder. We aim to improve the upstre…
DecoderMachine TranslationRetrievalSentence+1Rethinking Translation Memory Augmented Neural Machine Translation
This paper rethinks translation memory augmented neural machine translation (TM-augmented NMT) from two perspectives, i.e., a probabilistic view of retrieval and the variance-bias decomposition principle. The finding dem…
Machine TranslationNMTRetrievalTranslationImproving Retrieval-Augmented Neural Machine Translation with Monolingual Data
Conventional retrieval-augmented neural machine translation (RANMT) systems leverage bilingual corpora, e.g., translation memories (TMs). Yet, in many settings, in-domain monolingual target-side corpora are often availab…
Machine TranslationRetrievalSentenceTranslationNeural Machine Translation with Contrastive Translation Memories
Retrieval-augmented Neural Machine Translation models have been successful in many translation scenarios. Different from previous works that make use of mutually similar but redundant translation memories~(TMs), we propo…
Contrastive LearningMachine TranslationNMTRetrieval+2Neural Machine Translation with Monolingual Translation Memory
Prior work has proved that Translation memory (TM) can boost the performance of Neural Machine Translation (NMT). In contrast to existing work that uses bilingual corpus as TM and employs source-side similarity search fo…
Domain AdaptationMachine TranslationNMTRetrieval+1