paper-with-me

홈 › Papers

Domain-Specific Quality Estimation for Machine Translation in Low-Resource Scenarios

2026-03-07 · Namrata Patil Gurav, Akashdeep Ranu, Archchana Sindhujan, Diptesh Kanojia arxiv

Quality Estimation (QE) is essential for assessing machine translation quality in reference-less settings, particularly for domain-specific and low-resource language scenarios. In this paper, we investigate sentence-level QE for English to Indic machine translation across four domains (Healthcare, Legal, Tourism, and General) and five language pairs. We systematically compare zero-shot, few-shot, and guideline-anchored prompting across selected closed-weight and open-weight LLMs. Findings indicate that while closed-weight models achieve strong performance via prompting alone, prompt-only approaches remain fragile for open-weight models, especially in high-risk domains. To address this, we adopt ALOPE, a framework for LLM-based QE that uses Low-Rank Adaptation with regression heads attached to selected intermediate Transformer layers. We also extend ALOPE with recently proposed Low-Rank Multiplicative Adaptation (LoRMA). Our results show that intermediate-layer adaptation consistently improves QE performance, with gains in semantically complex domains, indicating a path toward more robust QE in practical scenarios. We release code and domain-specific QE datasets publicly to support further research.

📄 PDF Abstract BibTeX arXiv:2603.07372

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Translation

Similar Papers 제목 키워드 기반

Guiding In-Context Learning of LLMs through Quality Estimation for Machine Translation

2024-06-12 · Javad PourMostafa Roshan Sharami, Dimitar Shterionov, Pieter Spronck

The quality of output from large language models (LLMs), particularly in machine translation (MT), is closely tied to the quality of in-context examples (ICEs) provided along with the query, i.e., the text to translate. …

In-Context LearningLanguage ModelingLanguage ModellingMachine Translation+1

Toward domain-specific machine translation and quality estimation systems

2026-03-26 · Javad Pourmostafa Roshan Sharami arxiv

Machine Translation (MT) and Quality Estimation (QE) perform well in general domains but degrade under domain mismatch. This dissertation studies how to adapt MT and QE systems to specialized domains through a set of dat…

Machine TranslationData AugmentationDomain Adaptation

Tailoring Domain Adaptation for Machine Translation Quality Estimation

2023-04-18 · Javad PourMostafa Roshan Sharami, Dimitar Shterionov, Frédéric Blain, Eva Vanmassenhove 외

While quality estimation (QE) can play an important role in the translation process, its effectiveness relies on the availability and quality of training data. For QE in particular, high-quality labeled data is often lac…

Data AugmentationDomain AdaptationMachine TranslationTranslation+1

Findings of the WMT 2018 Shared Task on Quality Estimation

2018-10-01 · WS 2018 10 · Lucia Specia, Fr{\'e}d{\'e}ric Blain, Varvara Logacheva, Ram{\'o}n Astudillo 외

We report the results of the WMT18 shared task on Quality Estimation, i.e. the task of predicting the quality of the output of machine translation systems at various granularity levels: word, phrase, sentence and documen…

Machine TranslationSentenceTranslation

Machine Translation Quality Estimation Across Domains

2014-08-01 · COLING 2014 8 · Jos{\'e} G. C. de Souza, Marco Turchi, Matteo Negri
Machine TranslationTranslation