Regressive Ensemble for Machine Translation Quality Evaluation
This work introduces a simple regressive ensemble for evaluating machine translation quality based on a set of novel and established metrics. We evaluate the ensemble using a correlation to expert-based MQM scores of the WMT 2021 Metrics workshop. In both monolingual and zero-shot cross-lingual settings, we show a significant performance improvement over single metrics. In the cross-lingual settings, we also demonstrate that an ensemble approach is well-applicable to unseen languages. Furthermore, we identify a strong reference-free baseline that consistently outperforms the commonly-used BLEU and METEOR measures and significantly improves our ensemble's performance.
Code (1)
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Semi-Autoregressive Neural Machine Translation
Existing approaches to neural machine translation are typically autoregressive models. While these models attain state-of-the-art translation quality, they are suffering from low parallelizability and thus slow at decodi…
Machine TranslationTranslationGuiding Non-Autoregressive Neural Machine Translation Decoding with Reordering Information
Non-autoregressive neural machine translation (NAT) generates each target word in parallel and has achieved promising inference acceleration. However, existing NAT models still have a big gap in translation quality compa…
Machine TranslationTranslationEnsemble-based Transfer Learning for Low-resource Machine Translation Quality Estimation
Quality Estimation (QE) of Machine Translation (MT) is a task to estimate the quality scores for given translation outputs from an unknown MT system. However, QE scores for low-resource languages are usually intractable …
Machine TranslationMiscellaneousSentenceTransfer Learning+1Tencent AI Lab Machine Translation Systems for WMT20 Chat Translation Task
This paper describes the Tencent AI Lab’s submission of the WMT 2020 shared task on chat translation in English-German. Our neural machine translation (NMT) systems are built on sentence-level, document-level, non-autore…
General KnowledgeMachine TranslationNMTSentence+1Non-Autoregressive Translation with Layer-Wise Prediction and Deep Supervision
How do we perform efficient inference while retaining high translation quality? Existing neural machine translation models, such as Transformer, achieve high performance, but they decode words one by one, which is ineffi…
Machine TranslationTranslation