Exploring Recombination for Efficient Decoding of Neural Machine Translation
In Neural Machine Translation (NMT), the decoder can capture the features of the entire prediction history with neural connections and representations. This means that partial hypotheses with different prefixes will be regarded differently no matter how similar they are. However, this might be inefficient since some partial hypotheses can contain only local differences that will not influence future predictions. In this work, we introduce recombination in NMT decoding based on the concept of the "equivalence" of partial hypotheses. Heuristically, we use a simple $n$-gram suffix based equivalence function and adapt it into beam search decoding. Through experiments on large-scale Chinese-to-English and English-to-Germen translation tasks, we show that the proposed method can obtain similar translation quality with a smaller beam size, making NMT decoding more efficient.
Code (1)
Tasks
DecoderMachine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Massive-scale Decoding for Text Generation using Lattices
Conditional neural text generation models generate high-quality outputs, but often concentrate around a mode when what we really want is a diverse set of options. We present a search algorithm to construct lattices encod…
Document SummarizationMachine TranslationText GenerationTranslationNeural Machine Translation with Decoding History Enhanced Attention
Neural machine translation with source-side attention have achieved remarkable performance. however, there has been little work exploring to attend to the target-side which can potentially enhance the memory capbility of…
Language ModelingLanguage ModellingMachine TranslationNMT+1LSTM Language Models for LVCSR in First-Pass Decoding and Lattice-Rescoring
LSTM based language models are an important part of modern LVCSR systems as they significantly improve performance over traditional backoff language models. Incorporating them efficiently into decoding has been notorious…
Trainable Greedy Decoding for Neural Machine Translation
Recent research in neural machine translation has largely focused on two aspects; neural network architectures and end-to-end learning algorithms. The problem of decoding, however, has received relatively little attentio…
DecoderMachine TranslationTranslationExploring the traditional NMT model and Large Language Model for chat translation
This paper describes the submissions of Huawei Translation Services Center(HW-TSC) to WMT24 chat translation shared task on English$\leftrightarrow$Germany (en-de) bidirection. The experiments involved fine-tuning models…
Language ModelingLanguage ModellingLarge Language Modelmodel+2