Context-Aware Monolingual Human Evaluation of Machine Translation
This paper explores the potential of context-aware monolingual human evaluation for assessing machine translation (MT) when no source is given for reference. To this end, we compare monolingual with bilingual evaluations (with source text), under two scenarios: the evaluation of a single MT system, and the comparative evaluation of pairwise MT systems. Four professional translators performed both monolingual and bilingual evaluations by assigning ratings and annotating errors, and providing feedback on their experience. Our findings suggest that context-aware monolingual human evaluation achieves comparable outcomes to human bilingual evaluations, and suggest the feasibility and potential of monolingual evaluation as an efficient approach to assessing MT.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Context-Aware Monolingual Repair for Neural Machine Translation
Modern sentence-level NMT systems often produce plausible translations of isolated sentences. However, when put in context, these translations may end up being inconsistent with each other. We propose a monolingual DocRe…
Automatic Post-EditingMachine TranslationNMTSentence+1Exploring the Importance of Source Text in Automatic Post-Editing for Context-Aware Machine Translation
Accurate translation requires document-level information, which is ignored by sentence-level machine translation. Recent work has demonstrated that document-level consistency can be improved with automatic post-editing (…
Automatic Post-EditingMachine TranslationSentenceTranslationContext-aware Decoder for Neural Machine Translation using a Target-side Document-Level Language Model
Although many context-aware neural machine translation models have been proposed to incorporate contexts in translation, most of those models are trained end-to-end on parallel documents aligned in sentence-level. Becaus…
DecoderLanguage ModelingLanguage ModellingMachine Translation+2Further Investigation into Reference Bias in Monolingual Evaluation of Machine Translation
Monolingual evaluation of Machine Translation (MT) aims to simplify human assessment by requiring assessors to compare the meaning of the MT output with a reference translation, opening up the task to a much larger pool …
Machine TranslationTranslationMitigating Stylistic Biases of Machine Translation Systems via Monolingual Corpora Only
The advent of neural machine translation (NMT) has revolutionized cross-lingual communication, yet preserving stylistic nuances remains a significant challenge. While existing approaches often require parallel corpora fo…
Machine TranslationSemantic Similarity