paper-with-me

Papers

Reranking Machine Translation Hypotheses with Structured and Web-based Language Models

2021-04-25 · Wen Wang, Andreas Stolcke, Jing Zheng

In this paper, we investigate the use of linguistically motivated and computationally efficient structured language models for reranking N-best hypotheses in a statistical machine translation system. These language models, developed from Constraint Dependency Grammar parses, tightly integrate knowledge of words, morphological and lexical features, and syntactic dependency constraints. Two structured language models are applied for N-best rescoring, one is an almost-parsing language model, and the other utilizes more syntactic features by explicitly modeling syntactic dependencies between words. We also investigate effective and efficient language modeling methods to use N-grams extracted from up to 1 teraword of web documents. We apply all these language models for N-best re-ranking on the NIST and DARPA GALE program 2006 and 2007 machine translation evaluation tasks and find that the combination of these language models increases the BLEU score up to 1.6% absolutely on blind test sets.

📄 PDF Abstract BibTeX arXiv:2104.12277

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingMachine TranslationRerankingRe-RankingTranslation

Similar Papers 제목 키워드 기반

Discriminative Reranking for Neural Machine Translation

2021-08-01 · ACL 2021 5 · Ann Lee, Michael Auli, Marc{'}Aurelio Ranzato

Reranking models enable the integration of rich features to select a better output hypothesis within an n-best list or lattice. These models have a long history in NLP, and we revisit discriminative reranking for modern …

Data AugmentationMachine TranslationRerankingSentence+1

Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation

2024-06-17 · Boxuan Lyu, Hidetaka Kamigaito, Kotaro Funakoshi, Manabu Okumura

Maximum a posteriori decoding, a commonly used method for neural machine translation (NMT), aims to maximize the estimated posterior probability. However, high estimated probability does not always lead to high translati…

Machine TranslationNMTRerankingTranslation

An Empirical Study of Translation Hypothesis Ensembling with Large Language Models

2023-10-17 · António Farinhas, José G. C. de Souza, André F. T. Martins

Large language models (LLMs) are becoming a one-fits-many solution, but they sometimes hallucinate or produce unreliable output. In this paper, we investigate how hypothesis ensembling can improve the quality of the gene…

DiversityMachine TranslationRerankingTranslation

Don't Rank, Combine! Combining Machine Translation Hypotheses Using Quality Estimation

2024-01-12 · Giorgos Vernikos, Andrei Popescu-Belis

Neural machine translation systems estimate probabilities of target sentences given source sentences, yet these estimates may not align with human preferences. This work introduces QE-fusion, a method that synthesizes tr…

Machine TranslationRerankingTranslation

Accurate Knowledge Distillation with n-best Reranking

2023-05-20 · Hendra Setiawan

We propose utilizing n-best reranking to enhance Sequence-Level Knowledge Distillation (Kim and Rush, 2016) where we extract pseudo-labels for student model's training data from top n-best hypotheses and leverage a diver…

Knowledge DistillationRerankingTranslation