Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically motivated Test Suite
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Post-EditingCommon Sense ReasoningMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Multi-Dimensional Machine Translation Evaluation: Model Evaluation and Resource for Korean
Almost all frameworks for the manual or automatic evaluation of machine translation characterize the quality of an MT output with a single number. An exception is the Multidimensional Quality Metrics (MQM) framework whic…
Machine TranslationSentenceTranslationFine-grained evaluation of Quality Estimation for Machine translation based on a linguistically-motivated Test Suite
We present an alternative method of evaluating Quality Estimation systems, which is based on a linguistically-motivated Test Suite. We create a test-set consisting of 14 linguistic error categories and we gather for each…
Machine TranslationTranslationFine-Grained Reward Optimization for Machine Translation using Error Severity Mappings
Reinforcement learning (RL) has been proven to be an effective and robust method for training neural machine translation systems, especially when paired with powerful reward models that accurately assess translation qual…
DecoderMachine TranslationReinforcement Learning (RL)Sentence+1Unsupervised Word-level Quality Estimation for Machine Translation Through the Lens of Annotators (Dis)agreement
Word-level quality estimation (WQE) aims to automatically identify fine-grained error spans in machine-translated outputs and has found many uses, including assisting translators during post-editing. Modern WQE technique…
Language ModelingLanguage ModellingMachine TranslationTranslation+1There's no Data Like Better Data: Using QE Metrics for MT Data Filtering
Quality Estimation (QE), the evaluation of machine translation output without the need of explicit references, has seen big improvements in the last years with the use of neural metrics. In this paper we analyze the viab…
Machine TranslationNMTSentenceTranslation