Compact Personalized Models for Neural Machine Translation
We propose and compare methods for gradient-based domain adaptation of self-attentive neural machine translation models. We demonstrate that a large proportion of model parameters can be frozen during adaptation with minimal or no reduction in translation quality by encouraging structured sparsity in the set of offset tensors during learning via group lasso regularization. We evaluate this technique for both batch and incremental adaptation across multiple data sets and language pairs. Our system architecture - combining a state-of-the-art self-attentive model with compact domain adaptation - provides high quality personalized machine translation that is both space and time efficient.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Personalized Machine Translation: Preserving Original Author Traits
The language that we produce reflects our personality, and various personal and demographic characteristics can be detected in natural language texts. We focus on one particular personal trait of the author, gender, and …
Domain AdaptationMachine TranslationTranslationPersonalized Machine Translation: Predicting Translational Preferences
PePe: Personalized Post-editing Model utilizing User-generated Post-edits
Incorporating personal preference is crucial in advanced machine translation tasks. Despite the recent advancement of machine translation, it remains a demanding task to properly reflect personal style. In this paper, we…
Automatic Post-EditingMachine TranslationTranslationSteering Large Language Models for Machine Translation Personalization
High-quality machine translation systems based on large language models (LLMs) have simplified the production of personalized translations reflecting specific stylistic constraints. However, these systems still struggle …
Machine TranslationTranslationPairwise Neural Machine Translation Evaluation
We present a novel framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. …
Machine TranslationSentenceSentence EmbeddingsTranslation