Faster decoding for subword level Phrase-based SMT between related languages
A common and effective way to train translation systems between related languages is to consider sub-word level basic units. However, this increases the length of the sentences resulting in increased decoding time. The increase in length is also impacted by the specific choice of data format for representing the sentences as subwords. In a phrase-based SMT framework, we investigate different choices of decoder parameters as well as data format and their impact on decoding time and translation accuracy. We suggest best options for these settings that significantly improve decoding time with little impact on the translation accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderTranslationSimilar Papers 제목 키워드 기반
Contextualized Automatic Speech Recognition with Dynamic Vocabulary Prediction and Activation
Deep biasing improves automatic speech recognition (ASR) performance by incorporating contextual phrases. However, most existing methods enhance subwords in a contextual phrase as independent units, potentially compromis…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech RecognitionSubword Language Model for Query Auto-Completion
Current neural query auto-completion (QAC) systems rely on character-level language models, but they slow down when queries are long. We present how to utilize subword language models for the fast and accurate generation…
Language ModelingLanguage ModellingmodelRerankingSJD-PV: Speculative Jacobi Decoding with Phrase Verification for Autoregressive Image Generation
Autoregressive (AR) image models have recently demonstrated remarkable generative capability, but their sequential nature results in significant inference latency. Existing training-free acceleration methods typically ve…
Text-to-Image GenerationCharacter-based Neural Networks for Sentence Pair Modeling
Sentence pair modeling is critical for many NLP tasks, such as paraphrase identification, semantic textual similarity, and natural language inference. Most state-of-the-art neural models for these tasks rely on pretraine…
Language ModelingLanguage ModellingNatural Language InferenceParaphrase Identification+4Utilizing Lexical Similarity between Related, Low-resource Languages for Pivot-based SMT
We investigate pivot-based translation between related languages in a low resource, phrase-based SMT setting. We show that a subword-level pivot-based SMT model using a related pivot language is substantially better than…
Translation