Two Phase Evaluation for Selecting Machine Translation Services
An increased number of machine translation services are now available. Unfortunately, none of them can provide adequate translation quality for all input sources. This forces the user to select from among the services according to his needs. However, it is tedious and time consuming to perform this manual selection. Our solution, proposed here, is an automatic mechanism that can select the most appropriate machine translation service. Although evaluation methods are available, such as BLEU, NIST, WER, etc., their evaluation results are not unanimous regardless of the translation sources. We proposed a two-phase architecture for selecting translation services. The first phase uses a data-driven classification to allow the most appropriate evaluation method to be selected according to each translation source. The second phase selects the most appropriate machine translation result by the selected evaluation method. We describe the architecture, detail the algorithm, and construct a prototype. Tests show that the proposal yields better translation quality than employing just one machine translation service.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationVocal Bursts Valence PredictionSimilar Papers 제목 키워드 기반
A Shared Task on Bandit Learning for Machine Translation
We introduce and describe the results of a novel shared task on bandit learning for machine translation. The task was organized jointly by Amazon and Heidelberg University for the first time at the Second Conference on M…
Machine TranslationTranslationTowards Privacy-Preserving Machine Translation at the Inference Stage: A New Task and Benchmark
Current online translation services require sending user text to cloud servers, posing a risk of privacy leakage when the text contains sensitive information. This risk hinders the application of online translation servi…
Machine TranslationText ClassificationManual and Automatic Paraphrases for MT Evaluation
Paraphrasing of reference translations has been shown to improve the correlation with human judgements in automatic evaluation of machine translation (MT) outputs. In this work, we present a new dataset for evaluating En…
Machine TranslationTranslationEvaluation of Machine Translation Methods applied to Medical Terminologies
Medical terminologies resources and standards play vital roles in clinical data exchanges, enabling significantly the services’ interoperability within healthcare national information networks. Health and medical science…
Machine TranslationTranslationHW-TSC's Submission to the CCMT 2024 Machine Translation Tasks
This paper presents the submission of Huawei Translation Services Center (HW-TSC) to machine translation tasks of the 20th China Conference on Machine Translation (CCMT 2024). We participate in the bilingual machine tran…
Automatic Post-EditingEnsemble LearningLanguage ModelingLanguage Modelling+4