Quality Estimation and Translation Metrics via Pre-trained Word and Sentence Embeddings

2019-08-01 · WS 2019 8 · Elizaveta Yankovskaya, Andre T{\"a}ttar, Mark Fishel

We propose the use of pre-trained embeddings as features of a regression model for sentence-level quality estimation of machine translation. In our work we combine freely available BERT and LASER multilingual embeddings to train a neural-based regression model. In the second proposed method we use as an input features not only pre-trained embeddings, but also log probability of any machine translation (MT) system. Both methods are applied to several language pairs and are evaluated both as a classical quality estimation system (predicting the HTER score) as well as an MT metric (predicting human judgements of translation quality).

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Translation regressionSentenceSentence EmbeddingsTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Residual Connection 설명 없음

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Weight Decay 설명 없음

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Adam 설명 없음

Metrics for Evaluation of Word-level Machine Translation Quality Estimation

2016-08-01 · ACL 2016 8 · Varvara Logacheva, Michal Lukasik, Lucia Specia

Machine Translation Translation

Findings of the WMT 2019 Shared Tasks on Quality Estimation

2019-08-01 · WS 2019 8 · Erick Fonseca, Lisa Yankovskaya, Andr{\'e} F. T. Martins, Mark Fishel 외

We report the results of the WMT19 shared task on Quality Estimation, i.e. the task of predicting the quality of the output of machine translation systems given just the source text and the hypothesis translations. The t…

Machine Translation Sentence Translation

Revisiting Round-Trip Translation for Quality Estimation

2020-04-29 · EAMT 2020 11 · Jihyung Moon, Hyunchang Cho, Eunjeong L. Park

Quality estimation (QE) is the task of automatically evaluating the quality of translations without human-translated references. Calculating BLEU between the input sentence and round-trip translation (RTT) was once consi…

NMT Sentence Sentence Embeddings Translation

Unsupervised Word-level Quality Estimation for Machine Translation Through the Lens of Annotators (Dis)agreement

2025-05-29 · Gabriele Sarti, Vilém Zouhar, Malvina Nissim, Arianna Bisazza

Word-level quality estimation (WQE) aims to automatically identify fine-grained error spans in machine-translated outputs and has found many uses, including assisting translators during post-editing. Modern WQE technique…

Language Modeling Language Modelling Machine Translation Translation+1

SentSim: Crosslingual Semantic Evaluation of Machine Translation

2021-06-01 · NAACL 2021 4 · Yurun Song, Junchen Zhao, Lucia Specia

Machine translation (MT) is currently evaluated in one of two ways: in a monolingual fashion, by comparison with the system output to one or more human reference translations, or in a trained crosslingual fashion, by bui…

Machine Translation Semantic Similarity Semantic Textual Similarity Sentence+1