Quality Estimation Using Round-trip Translation with Sentence Embeddings
Estimating the quality of machine translation systems has been an ongoing challenge for researchers in this field. Many previous attempts at using round-trip translation as a measure of quality have failed, and there is much disagreement as to whether it can be a viable method of quality estimation. In this paper, we revisit round-trip translation, proposing a system which aims to solve the previous pitfalls found with the approach. Our method makes use of recent advances in language representation learning to more accurately gauge the similarity between the original and round-trip translated sentences. Experiments show that while our approach does not reach the performance of current state of the art methods, it may still be an effective approach for some language pairs.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationRepresentation LearningSentenceSentence EmbeddingsTranslationSimilar Papers 제목 키워드 기반
Revisiting Round-Trip Translation for Quality Estimation
Quality estimation (QE) is the task of automatically evaluating the quality of translations without human-translated references. Calculating BLEU between the input sentence and round-trip translation (RTT) was once consi…
NMTSentenceSentence EmbeddingsTranslationRethinking Round-Trip Translation for Machine Translation Evaluation
Automatic evaluation on low-resource language translation suffers from a deficiency of parallel corpora. Round-trip translation could be served as a clever and straightforward technique to alleviate the requirement of th…
Machine TranslationTranslationAutomatic Generation of Distractors for Fill-in-the-Blank Exercises with Round-Trip Neural Machine Translation
In a fill-in-the-blank exercise, a student is presented with a carrier sentence with one word hidden, and a multiple-choice list that includes the correct answer and several inappropriate options, called distractors. We …
Machine TranslationMultiple-choiceSentenceTranslationFiltering Back-Translated Data in Unsupervised Neural Machine Translation
Unsupervised neural machine translation (NMT) utilizes only monolingual data for training. The quality of back-translated data plays an important role in the performance of NMT systems. In back-translation, all generated…
Domain AdaptationMachine TranslationNMTSentence+1COMET-QE and Active Learning for Low-Resource Machine Translation
Active learning aims to deliver maximum benefit when resources are scarce. We use COMET-QE, a reference-free evaluation metric, to select sentences for low-resource neural machine translation. Using Swahili, Kinyarwanda …
Active LearningLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine Translation+2