paper-with-me

홈 › Papers

Enhanced Simultaneous Machine Translation with Word-level Policies

2023-10-25 · Kang Kim, Hankyu Cho

Recent years have seen remarkable advances in the field of Simultaneous Machine Translation (SiMT) due to the introduction of innovative policies that dictate whether to READ or WRITE at each step of the translation process. However, a common assumption in many existing studies is that operations are carried out at the subword level, even though the standard unit for input and output in most practical scenarios is typically at the word level. This paper demonstrates that policies devised and validated at the subword level are surpassed by those operating at the word level, which process multiple subwords to form a complete word in a single step. Additionally, we suggest a method to boost SiMT models using language models (LMs), wherein the proposed word-level policy plays a vital role in addressing the subword disparity between LMs and SiMT models. Code is available at https://github.com/xl8-ai/WordSiMT.

📄 PDF Abstract BibTeX arXiv:2310.16417

Code (1)

xl8-ai/wordsimt 공식 구현 pytorch

Tasks

Machine TranslationTranslation

Similar Papers 제목 키워드 기반

Monotonic Simultaneous Translation with Chunk-wise Reordering and Refinement

2021-10-18 · WMT (EMNLP) 2021 11 · Hyojung Han, Seokchan Ahn, Yoonjung Choi, Insoo Chung 외

Recent work in simultaneous machine translation is often trained with conventional full sentence translation corpora, leading to either excessive latency or necessity to anticipate as-yet-unarrived words, when dealing wi…

Machine TranslationSentenceTranslationWord Alignment

CBSiMT: Mitigating Hallucination in Simultaneous Machine Translation with Weighted Prefix-to-Prefix Training

2023-11-07 · Mengge Liu, Wen Zhang, Xiang Li, Yanzhi Tian 외

Simultaneous machine translation (SiMT) is a challenging task that requires starting translation before the full source sentence is available. Prefix-to-prefix framework is often applied to SiMT, which learns to predict …

HallucinationMachine TranslationSentenceTranslation

Finding Better Subword Segmentation for Neural Machine Translation

2018-07-25 · Yingting Wu, Hai Zhao

For different language pairs, word-level neural machine translation (NMT) models with a fixed-size vocabulary suffer from the same problem of representing out-of-vocabulary (OOV) words. The common practice usually replac…

Machine TranslationNMTSegmentationTranslation

SiLLM: Large Language Models for Simultaneous Machine Translation

2024-02-20 · Shoutao Guo, Shaolei Zhang, Zhengrui Ma, Min Zhang 외

Simultaneous Machine Translation (SiMT) generates translations while reading the source sentence, necessitating a policy to determine the optimal timing for reading and generating words. Despite the remarkable performanc…

Machine TranslationSentenceTranslation

A Generative Framework for Simultaneous Machine Translation

2021-11-01 · EMNLP 2021 11 · Yishu Miao, Phil Blunsom, Lucia Specia

We propose a generative framework for simultaneous machine translation. Conventional approaches use a fixed number of source words to translate or learn dynamic policies for the number of source words by reinforcement le…

Machine Translationreinforcement-learningReinforcement Learning (RL)Translation