paper-with-me

홈 › Papers

Non-Monotonic Attention-based Read/Write Policy Learning for Simultaneous Translation

2025-03-28 · Zeeshan Ahmed, Frank Seide, Zhe Liu, Rastislav Rabatin, Jachym Kolar, Niko Moritz, Ruiming Xie, Simone Merello, Christian Fuegen

Simultaneous or streaming machine translation generates translation while reading the input stream. These systems face a quality/latency trade-off, aiming to achieve high translation quality similar to non-streaming models with minimal latency. We propose an approach that efficiently manages this trade-off. By enhancing a pretrained non-streaming model, which was trained with a seq2seq mechanism and represents the upper bound in quality, we convert it into a streaming model by utilizing the alignment between source and target tokens. This alignment is used to learn a read/write decision boundary for reliable translation generation with minimal input. During training, the model learns the decision boundary through a read/write policy module, employing supervised learning on the alignment points (pseudo labels). The read/write policy module, a small binary classification unit, can control the quality/latency trade-off during inference. Experimental results show that our model outperforms several strong baselines and narrows the gap with the non-streaming baseline model.

📄 PDF Abstract BibTeX arXiv:2503.22051

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationMachine TranslationTranslation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

Language Model Augmented Monotonic Attention for Simultaneous Translation

2022-07-01 · NAACL 2022 7 · Sathish Reddy Indurthi, Mohd Abbas Zaidi, Beomseok Lee, Nikhil Kumar Lakumarapu 외

The state-of-the-art adaptive policies for Simultaneous Neural Machine Translation (SNMT) use monotonic attention to perform read/write decisions based on the partial source and target sequences. The lack of sufficient i…

Language ModelingLanguage ModellingMachine Translationmodel+3

Infusing Future Information into Monotonic Attention Through Language Models

2021-09-07 · Mohd Abbas Zaidi, Sathish Indurthi, Beomseok Lee, Nikhil Kumar Lakumarapu 외

Simultaneous neural machine translation(SNMT) models start emitting the target sequence before they have processed the source sequence. The recent adaptive policies for SNMT use monotonic attention to perform read/write …

Language ModelingLanguage ModellingMachine TranslationSpeech-to-Text+2

Towards Stream Translation: Adaptive Computation Time for Simultaneous Machine Translation

2020-07-01 · WS 2020 7 · Felix Schneider, Alex Waibel, er

Simultaneous machine translation systems rely on a policy to schedule read and write operations in order to begin translating a source sentence before it is complete. In this paper, we demonstrate the use of Adaptive Com…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine TranslationSentence+3

Exploring Continuous Integrate-and-Fire for Adaptive Simultaneous Speech Translation

2022-03-22 · Chih-Chiang Chang, Hung-Yi Lee

Simultaneous speech translation (SimulST) is a challenging task aiming to translate streaming speech before the complete input is observed. A SimulST system generally includes two components: the pre-decision that aggreg…

Translation

Cross Attention Augmented Transducer Networks for Simultaneous Translation

2021-11-01 · EMNLP 2021 11 · Dan Liu, Mengge Du, Xiaoxi Li, Ya Li 외

This paper proposes a novel architecture, Cross Attention Augmented Transducer (CAAT), for simultaneous translation. The framework aims to jointly optimize the policy and translation models. To effectively consider all p…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Decoderspeech-recognition+3