Boosting Neural Machine Translation with Similar Translations
This paper explores data augmentation methods for training Neural Machine Translation to make use of similar translations, in a comparable way a human translator employs fuzzy matches. In particular, we show how we can simply present the neural model with information of both source and target sides of the fuzzy matches, we also extend the similarity to include semantically related translations retrieved using sentence distributed representations. We show that translations based on fuzzy matching provide the model with {`}copy{''} information while translations based on embedding similarities tend to extend the translation {`}context{''}. Results indicate that the effect from both similar sentences are adding up to further boost accuracy, combine naturally with model fine-tuning and are providing dynamic adaptation for unseen translation pairs. Tests on multiple data sets and domains show consistent accuracy improvements. To foster research around these techniques, we also release an Open-Source toolkit with efficient and flexible fuzzy-match implementation.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationMachine TranslationSentenceTranslationSimilar Papers 제목 키워드 기반
The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilities
Fine-tuning large language models (LLMs) for machine translation has shown improvements in overall translation quality. However, it is unclear what is the impact of fine-tuning on desirable LLM behaviors that are not pre…
Machine TranslationTranslationLexically Cohesive Neural Machine Translation with Copy Mechanism
Lexically cohesive translations preserve consistency in word choices in document-level translation. We employ a copy mechanism into a context-aware neural machine translation model to allow copying words from previous tr…
Machine TranslationTranslationAssessing Human Translations from French to Bambara for Machine Learning: a Pilot Study
We present novel methods for assessing the quality of human-translated aligned texts for learning machine translation models of under-resourced languages. Malian university students translated French texts, producing eit…
BIG-bench Machine LearningMachine TranslationTranslationDo GPTs Produce Less Literal Translations?
Large Language Models (LLMs) such as GPT-3 have emerged as general-purpose language models capable of addressing many natural language generation or understanding tasks. On the task of Machine Translation (MT), multiple …
Machine TranslationNMTText GenerationTranslation+1Extending a model for ontology-based Arabic-English machine translation
The acceleration in telecommunication needs leads to many groups of research, especially in communication facilitating and Machine Translation fields. While people contact with others having different languages and cultu…
ArticlesMachine TranslationTranslation