Domain Adaptive Inference for Neural Machine Translation

2019-06-02 · ACL 2019 7 · Danielle Saunders, Felix Stahlberg, Adria de Gispert, Bill Byrne

We investigate adaptive ensemble weighting for Neural Machine Translation, addressing the case of improving performance on a new and potentially unknown domain without sacrificing performance on the original domain. We adapt sequentially across two Spanish-English and three English-German tasks, comparing unregularized fine-tuning, L2 and Elastic Weight Consolidation. We then report a novel scheme for adaptive NMT ensemble decoding by extending Bayesian Interpolation with source information, and show strong improvements across test domains without access to the domain label.

📄 PDF Abstract BibTeX arXiv:1906.00408

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNMTTranslation

Language Modelling Approaches to Adaptive Machine Translation

2024-01-25 · Yasmin Moslem

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has…

Data Augmentation Domain Adaptation In-Context Learning Language Modelling+3

Fine-tuning Large Language Models for Adaptive Machine Translation

2023-12-20 · Yasmin Moslem, Rejwanul Haque, Andy Way

This paper presents the outcomes of fine-tuning Mistral 7B, a general-purpose large language model (LLM), for adaptive machine translation (MT). The fine-tuning process involves utilising a combination of zero-shot and o…

In-Context Learning Language Modelling Large Language Model Machine Translation+1

Simply Trainable Nearest Neighbour Machine Translation with GPU Inference

2024-07-29 · Hossam Amer, Abdelrahman Abouelenin, Mohamed Maher, Evram Narouz 외

Nearest neighbor machine translation is a successful approach for fast domain adaption, which interpolates the pre-trained transformers with domain-specific token-level k-nearest-neighbor (kNN) retrieval without retraini…

Domain Adaptation GPU Machine Translation Sentence+1

Adaptive Machine Translation with Large Language Models

2023-01-30 · Yasmin Moslem, Rejwanul Haque, John D. Kelleher, Andy Way

Decoder Domain Adaptation In-Context Learning Information Retrieval+5

Distilling Multiple Domains for Neural Machine Translation

2020-11-01 · EMNLP 2020 11 · Anna Currey, Prashant Mathur, Georgiana Dinu

Neural machine translation achieves impressive results in high-resource conditions, but performance often suffers when the input domain is low-resource. The standard practice of adapting a separate model for each domain …

Machine Translation Translation