Learning Kernel-Smoothed Machine Translation with Retrieved Examples
How to effectively adapt neural machine translation (NMT) models according to emerging cases without retraining? Despite the great success of neural machine translation, updating the deployed models online remains a challenge. Existing non-parametric approaches that retrieve similar examples from a database to guide the translation process are promising but are prone to overfit the retrieved examples. In this work, we propose to learn Kernel-Smoothed Translation with Example Retrieval (KSTER), an effective approach to adapt neural machine translation models online. Experiments on domain adaptation and multi-domain machine translation datasets show that even without expensive retraining, KSTER is able to achieve improvement of 1.1 to 1.5 BLEU scores over the best existing online adaptation methods. The code and trained models are released at https://github.com/jiangqn/KSTER.
Code (2)
Tasks
Domain AdaptationMachine TranslationNMTRetrievalTranslationSimilar Papers 제목 키워드 기반
Guiding Neural Machine Translation with Retrieved Translation Pieces
One of the difficulties of neural machine translation (NMT) is the recall and appropriate translation of low-frequency words or phrases. In this paper, we propose a simple, fast, and effective method for recalling previo…
Machine TranslationNMTRetrievalSentence+1An Empirical Study of Many-Shot In-Context Learning for Machine Translation of Low-Resource Languages
In-context learning (ICL) allows large language models (LLMs) to adapt to new tasks from a few examples, making it promising for languages underrepresented in pre-training. Recent work on many-shot ICL suggests that mode…
Machine TranslationRetrieving Examples from Memory for Retrieval Augmented Neural Machine Translation: A Systematic Comparison
Retrieval-Augmented Neural Machine Translation (RAMT) architectures retrieve examples from memory to guide the generation process. While most works in this trend explore new ways to exploit the retrieved examples, the up…
DiversityIn-Context LearningLanguage ModelingLanguage Modelling+4Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approach
Direct speech translation (ST) models often struggle with rare words. Incorrect translation of these words can have severe consequences, impacting translation quality and user trust. While rare word translation is inhere…
In-Context LearningRetrievalSparse LearningSpeech-to-Text+2Pointwise HSIC: A Linear-Time Kernelized Co-occurrence Norm for Sparse Linguistic Expressions
In this paper, we propose a new kernel-based co-occurrence measure that can be applied to sparse linguistic expressions (e.g., sentences) with a very short learning time, as an alternative to pointwise mutual information…
Machine TranslationSentenceSentence EmbeddingsTranslation