Findings of the WMT 2021 Shared Task on Quality Estimation
We report the results of the WMT 2021 shared task on Quality Estimation, where the challenge is to predict the quality of the output of neural machine translation systems at the word and sentence levels. This edition focused on two main novel additions: (i) prediction for unseen languages, i.e. zero-shot settings, and (ii) prediction of sentences with catastrophic errors. In addition, new data was released for a number of languages, especially post-edited data. Participating teams from 19 institutions submitted altogether 1263 systems to different task variants and language pairs.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationPredictionSentenceTranslationSimilar Papers 제목 키워드 기반
Findings of the WMT 2018 Shared Task on Quality Estimation
We report the results of the WMT18 shared task on Quality Estimation, i.e. the task of predicting the quality of the output of machine translation systems at various granularity levels: word, phrase, sentence and documen…
Machine TranslationSentenceTranslationFindings of the WMT 2019 Shared Tasks on Quality Estimation
We report the results of the WMT19 shared task on Quality Estimation, i.e. the task of predicting the quality of the output of machine translation systems given just the source text and the hypothesis translations. The t…
Machine TranslationSentenceTranslationFindings of the WMT 2020 Shared Task on Quality Estimation
We report the results of the WMT20 shared task on Quality Estimation, where the challenge is to predict the quality of the output of neural machine translation systems at the word, sentence and document levels. This edit…
Machine TranslationSentenceTranslationThe Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results
In this paper, we introduce the Eval4NLP-2021shared task on explainable quality estimation. Given a source-translation pair, this shared task requires not only to provide a sentence-level score indicating the overall qua…
SentenceTranslationThe JHU-Microsoft Submission for WMT21 Quality Estimation Shared Task
This paper presents the JHU-Microsoft joint submission for WMT 2021 quality estimation shared task. We only participate in Task 2 (post-editing effort estimation) of the shared task, focusing on the target-side word-leve…
Data AugmentationTask 2Translation