paper-with-me

Papers

Quality-Aware Decoding: Unifying Quality Estimation and Decoding

2025-02-12 · Sai Koneru, Matthias Huck, Miriam Exel, Jan Niehues

An emerging research direction in NMT involves the use of Quality Estimation (QE) models, which have demonstrated high correlations with human judgment and can enhance translations through Quality-Aware Decoding. Although several approaches have been proposed based on sampling multiple candidate translations, none have integrated these models directly into the decoding process. In this paper, we address this by proposing a novel token-level QE model capable of reliably scoring partial translations. We build a uni-directional QE model for this, as decoder models are inherently trained and efficient on partial sequences. We then present a decoding strategy that integrates the QE model for Quality-Aware decoding and demonstrate that the translation quality improves when compared to the N-best list re-ranking with state-of-the-art QE models (upto $1.39$ XCOMET-XXL $\uparrow$). Finally, we show that our approach provides significant benefits in document translation tasks, where the quality of N-best lists is typically suboptimal.

📄 PDF Abstract BibTeX arXiv:2502.08561

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDocument TranslationNMTRe-RankingTranslation

Similar Papers 제목 키워드 기반

Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model

2023-10-10 · Christian Tomani, David Vilar, Markus Freitag, Colin Cherry 외

Maximum-a-posteriori (MAP) decoding is the most widely used decoding strategy for neural machine translation (NMT) models. The underlying assumption is that model probability correlates well with human judgment, with bet…

Machine TranslationNMTRerankingTranslation

Quality-Aware Decoding for Neural Machine Translation

2022-05-02 · NAACL 2022 7 · Patrick Fernandes, António Farinhas, Ricardo Rei, José G. C. de Souza 외

Despite the progress in machine translation quality estimation and evaluation in the last years, decoding in neural machine translation (NMT) is mostly oblivious to this and centers around finding the most probable trans…

Machine TranslationNMTRerankingTranslation

Quality-Aware Decoding for Neural Machine Translation

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Despite the progress in machine translation quality estimation and evaluation in the last years, decoding in neural machine translation (NMT) is mostly oblivious to this and centers around finding the most probable trans…

Machine TranslationNMTRerankingTranslation

Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?

2022-11-25 · Pei Zhang, Baosong Yang, Haoran Wei, Dayiheng Liu 외

Neural machine translation (NMT) is often criticized for failures that happen without awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback …

Machine TranslationNMTSentenceTranslation

Watching the Watchers: Exposing Gender Disparities in Machine Translation Quality Estimation

2024-10-14 · Emmanouil Zaranis, Giuseppe Attanasio, Sweta Agrawal, André F. T. Martins

The automatic assessment of translation quality has recently become crucial across several stages of the translation pipeline, from data curation to training and decoding. Although quality estimation (QE) metrics have be…

Machine TranslationTranslation