Improving both domain robustness and domain adaptability in machine translation
We address two problems of domain adaptation in neural machine translation. First, we want to reach domain robustness, i.e., good quality of both domains from the training data, and domains unseen in the training data. Second, we want our systems to be adaptive, i.e., making it possible to finetune systems with just hundreds of in-domain parallel sentences. In this paper, we introduce a novel combination of two previous approaches, word adaptive modelling, which addresses domain robustness, and meta-learning, which addresses domain adaptability, and we present empirical results showing that our new combination improves both of these properties. Our source code is attached and will be made publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationMachine TranslationMeta-LearningTranslationSimilar Papers 제목 키워드 기반
Improving Both Domain Robustness and Domain Adaptability in Machine Translation
We consider two problems of NMT domain adaptation using meta-learning. First, we want to reach domain robustness, i.e., we want to reach high quality on both domains seen in the training data and unseen domains. Second, …
Domain AdaptationMachine TranslationMeta-LearningNMT+1Epi-Curriculum: Episodic Curriculum Learning for Low-Resource Domain Adaptation in Neural Machine Translation
Neural Machine Translation (NMT) models have become successful, but their performance remains poor when translating on new domains with a limited number of data. In this paper, we present a novel approach Epi-Curriculum …
DecoderDomain AdaptationMachine TranslationNMT+1TAROT: Towards Essentially Domain-Invariant Robustness with Theoretical Justification
Robust domain adaptation against adversarial attacks is a critical research area that aims to develop models capable of maintaining consistent performance across diverse and challenging domains. In this paper, we derive …
Domain AdaptationDomain GeneralizationCLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey
As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for enhancing model robustness across diverse environments. Contrastive Language-Image Pretraining (CLIP) plays a sig…
Computational EfficiencyDomain AdaptationDomain GeneralizationPrompt Learning+2How Well Does GPT-4V(ision) Adapt to Distribution Shifts? A Preliminary Investigation
In machine learning, generalization against distribution shifts -- where deployment conditions diverge from the training scenarios -- is crucial, particularly in fields like climate modeling, biomedicine, and autonomous …
Anomaly DetectionAutonomous DrivingBenchmarkingImage Generation+4