Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task
This paper presents the submission of Huawei Translate Services Center (HW-TSC) to the WMT24 general machine translation (MT) shared task, where we participate in the English to Chinese (en2zh) language pair. Similar to previous years' work, we use training strategies such as regularized dropout, bidirectional training, data diversification, forward translation, back translation, alternated training, curriculum learning, and transductive ensemble learning to train the neural machine translation (NMT) model based on the deep Transformer-big architecture. The difference is that we also use continue pre-training, supervised fine-tuning, and contrastive preference optimization to train the large language model (LLM) based MT model. By using Minimum Bayesian risk (MBR) decoding to select the final translation from multiple hypotheses for NMT and LLM-based MT models, our submission receives competitive results in the final evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
Ensemble LearningLanguage ModelingLanguage ModellingLarge Language ModelMachine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Single-Queue Decoding for Neural Machine Translation
Neural machine translation models rely on the beam search algorithm for decoding. In practice, we found that the quality of hypotheses in the search space is negatively affected owing to the fixed beam size. To mitigate …
Machine TranslationTranslationAn Empirical Study of Translation Hypothesis Ensembling with Large Language Models
Large language models (LLMs) are becoming a one-fits-many solution, but they sometimes hallucinate or produce unreliable output. In this paper, we investigate how hypothesis ensembling can improve the quality of the gene…
DiversityMachine TranslationRerankingTranslationImproving Beam Search by Removing Monotonic Constraint for Neural Machine Translation
To achieve high translation performance, neural machine translation models usually rely on the beam search algorithm for decoding sentences. The beam search finds good candidate translations by considering multiple hypot…
Language ModelingLanguage ModellingMachine TranslationTranslationTSMind: Alibaba and Soochow University's Submission to the WMT22 Translation Suggestion Task
This paper describes the joint submission of Alibaba and Soochow University, TSMind, to the WMT 2022 Shared Task on Translation Suggestion (TS). We participate in the English-German and English-Chinese tasks. Basically, …
Data AugmentationLanguage ModelingLanguage ModellingTranslationExploring Recombination for Efficient Decoding of Neural Machine Translation
In Neural Machine Translation (NMT), the decoder can capture the features of the entire prediction history with neural connections and representations. This means that partial hypotheses with different prefixes will be r…
DecoderMachine TranslationNMTTranslation