TransQuest: Translation Quality Estimation with Cross-lingual Transformers
Recent years have seen big advances in the field of sentence-level quality estimation (QE), largely as a result of using neural-based architectures. However, the majority of these methods work only on the language pair they are trained on and need retraining for new language pairs. This process can prove difficult from a technical point of view and is usually computationally expensive. In this paper we propose a simple QE framework based on cross-lingual transformers, and we use it to implement and evaluate two different neural architectures. Our evaluation shows that the proposed methods achieve state-of-the-art results outperforming current open-source quality estimation frameworks when trained on datasets from WMT. In addition, the framework proves very useful in transfer learning settings, especially when dealing with low-resourced languages, allowing us to obtain very competitive results.
Code (1)
Tasks
SentenceTransfer LearningTranslationSimilar Papers 제목 키워드 기반
MTQE.en-he: Machine Translation Quality Estimation for English-Hebrew
We release MTQE.en-he: to our knowledge, the first publicly available English-Hebrew benchmark for Machine Translation Quality Estimation. MTQE.en-he contains 959 English segments from WMT24++, each paired with a machine…
Machine TranslationSurreyAI 2023 Submission for the Quality Estimation Shared Task
Quality Estimation (QE) systems are important in situations where it is necessary to assess the quality of translations, but there is no reference available. This paper describes the approach adopted by the SurreyAI team…
SentenceTransQuest at WMT2020: Sentence-Level Direct Assessment
This paper presents the team TransQuest's participation in Sentence-Level Direct Assessment shared task in WMT 2020. We introduce a simple QE framework based on cross-lingual transformers, and we use it to implement and …
Data AugmentationSentenceVerdi: Quality Estimation and Error Detection for Bilingual Corpora
Translation Quality Estimation is critical to reducing post-editing efforts in machine translation and to cross-lingual corpus cleaning. As a research problem, quality estimation (QE) aims to directly estimate the qualit…
Language ModellingMachine TranslationNMTSentence+1Translation Quality Estimation by Jointly Learning to Score and Rank
The translation quality estimation (QE) task, particularly the QE as a Metric task, aims to evaluate the general quality of a translation based on the translation and the source sentence without using reference translati…
Multi-Task LearningSentenceSentence EmbeddingsTranslation