paper-with-me

Papers

Automatic Machine Translation Evaluation using Source Language Inputs and Cross-lingual Language Model

2020-07-01 · ACL 2020 6 · Kosuke Takahashi, Katsuhito Sudoh, Satoshi Nakamura

We propose an automatic evaluation method of machine translation that uses source language sentences regarded as additional pseudo references. The proposed method evaluates a translation hypothesis in a regression model. The model takes the paired source, reference, and hypothesis sentence all together as an input. A pretrained large scale cross-lingual language model encodes the input to sentence-pair vectors, and the model predicts a human evaluation score with those vectors. Our experiments show that our proposed method using Cross-lingual Language Model (XLM) trained with a translation language modeling (TLM) objective achieves a higher correlation with human judgments than a baseline method that uses only hypothesis and reference sentences. Additionally, using source sentences in our proposed method is confirmed to improve the evaluation performance.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingMachine TranslationSentenceTranslation

Similar Papers 제목 키워드 기반

An Automatic Evaluation of the WMT22 General Machine Translation Task

2022-09-28 · Benjamin Marie

This report presents an automatic evaluation of the general machine translation task of the Seventh Conference on Machine Translation (WMT22). It evaluates a total of 185 systems for 21 translation directions including h…

Machine TranslationTranslation

Attention based Sequence to Sequence Learning for Machine Translation of Low Resourced Indic Languages -- A case of Sanskrit to Hindi

2021-09-07 · Vishvajit Bakarola, Jitendra Nasriwala

Deep Learning techniques are powerful in mimicking humans in a particular set of problems. They have achieved a remarkable performance in complex learning tasks. Deep learning inspired Neural Machine Translation (NMT) is…

Machine TranslationNMTTranslation

Exploring the Importance of Source Text in Automatic Post-Editing for Context-Aware Machine Translation

2021-05-01 · NoDaLiDa 2021 5 · Chaojun Wang, Christian Hardmeier, Rico Sennrich

Accurate translation requires document-level information, which is ignored by sentence-level machine translation. Recent work has demonstrated that document-level consistency can be improved with automatic post-editing (…

Automatic Post-EditingMachine TranslationSentenceTranslation

Extended Parallel Corpus for Amharic-English Machine Translation

2021-04-08 · LREC 2022 6 · Andargachew Mekonnen Gezmu, Andreas Nürnberger, Tesfaye Bayu Bati

This paper describes the acquisition, preprocessing, segmentation, and alignment of an Amharic-English parallel corpus. It will be helpful for machine translation of a low-resource language, Amharic. We freely released t…

Language ModelingLanguage ModellingMachine TranslationTranslation

Findings of the WMT 2018 Biomedical Translation Shared Task: Evaluation on Medline test sets

2018-10-01 · WS 2018 10 · Mariana Neves, Antonio Jimeno Yepes, Aur{\'e}lie N{\'e}v{\'e}ol, Cristian Grozea 외

Machine translation enables the automatic translation of textual documents between languages and can facilitate access to information only available in a given language for non-speakers of this language, e.g. research re…

Machine TranslationTranslation