paper-with-me

홈 › Papers

ICL’s Submission to the WMT21 Critical Error Detection Shared Task

2021-11-01 · WMT (EMNLP) 2021 11 · Genze Jiang, Zhenhao Li, Lucia Specia

This paper presents Imperial College London’s submissions to the WMT21 Quality Estimation (QE) Shared Task 3: Critical Error Detection. Our approach builds on cross-lingual pre-trained representations in a sequence classification model. We further improve the base classifier by (i) adding a weighted sampler to deal with unbalanced data and (ii) introducing feature engineering, where features related to toxicity, named-entities and sentiment, which are potentially indicative of critical errors, are extracted using existing tools and integrated to the model in different ways. We train models with one type of feature at a time and ensemble those models that improve over the base classifier on the development (dev) set. Our official submissions achieve very competitive results, ranking second for three out of four language pairs.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Feature Engineering

Similar Papers 제목 키워드 기반

NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection

2021-11-01 · WMT (EMNLP) 2021 11 · Raphael Rubino, Atsushi Fujita, Benjamin Marie

This paper presents the NICT Kyoto submission for the WMT’21 Quality Estimation (QE) Critical Error Detection shared task (Task 3). Our approach relies mainly on QE model pretraining for which we used 11 language pairs, …

Language ModelingLanguage ModellingMasked Language ModelingSentence+2

QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Task

2021-12-30 · Jiayi Wang, Ke Wang, Boxing Chen, Yu Zhao 외

Quality Estimation, as a crucial step of quality control for machine translation, has been explored for years. The goal is to investigate automatic methods for estimating the quality of machine translation results withou…

Machine TranslationSentenceTranslation

QEMind: Alibaba’s Submission to the WMT21 Quality Estimation Shared Task

2021-11-01 · WMT (EMNLP) 2021 11 · Jiayi Wang, Ke Wang, Boxing Chen, Yu Zhao 외

Quality Estimation, as a crucial step of quality control for machine translation, has been explored for years. The goal is to to investigate automatic methods for estimating the quality of machine translation results wit…

Machine TranslationSentenceTranslation

CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task

2022-09-13 · Ricardo Rei, Marcos Treviso, Nuno M. Guerreiro, Chrysoula Zerva 외

We present the joint contribution of IST and Unbabel to the WMT 2022 Shared Task on Quality Estimation (QE). Our team participated on all three subtasks: (i) Sentence and Word-level Quality Prediction; (ii) Explainable Q…

AllSentence

MetricX-25 and GemSpanEval: Google Translate Submissions to the WMT25 Evaluation Shared Task

2025-10-28 · Juraj Juraska, Tobias Domhan, Mara Finkelstein, Tetsuji Nakagawa 외 arxiv

In this paper, we present our submissions to the unified WMT25 Translation Evaluation Shared Task. For the Quality Score Prediction subtask, we create a new generation of MetricX with improvements in the input format and…