paper-with-me

Papers

Glancing Future for Simultaneous Machine Translation

2023-09-12 · Shoutao Guo, Shaolei Zhang, Yang Feng

Simultaneous machine translation (SiMT) outputs translation while reading the source sentence. Unlike conventional sequence-to-sequence (seq2seq) training, existing SiMT methods adopt the prefix-to-prefix (prefix2prefix) training, where the model predicts target tokens based on partial source tokens. However, the prefix2prefix training diminishes the ability of the model to capture global information and introduces forced predictions due to the absence of essential source information. Consequently, it is crucial to bridge the gap between the prefix2prefix training and seq2seq training to enhance the translation capability of the SiMT model. In this paper, we propose a novel method that glances future in curriculum learning to achieve the transition from the seq2seq training to prefix2prefix training. Specifically, we gradually reduce the available source information from the whole sentence to the prefix corresponding to that latency. Our method is applicable to a wide range of SiMT methods and experiments demonstrate that our method outperforms strong baselines.

📄 PDF Abstract BibTeX arXiv:2309.06179

Code (1)

ictnlp/glance-simt 공식 구현 pytorch

Tasks

Machine TranslationSentenceTranslation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

Glancing Transformer for Non-Autoregressive Neural Machine Translation

2020-08-18 · ACL 2021 5 · Lihua Qian, Hao Zhou, Yu Bao, Mingxuan Wang 외

Recent work on non-autoregressive neural machine translation (NAT) aims at improving the efficiency by parallel decoding without sacrificing the quality. However, existing NAT methods are either inferior to Transformer o…

Language ModelingLanguage ModellingMachine TranslationTranslation

Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning

2022-12-20 · Lihua Qian, Mingxuan Wang, Yang Liu, Hao Zhou

Previously, non-autoregressive models were widely perceived as being superior in generation efficiency but inferior in generation quality due to the difficulties of modeling multiple target modalities. To enhance the mul…

Knowledge DistillationMachine TranslationText Generation

CTC-based Non-autoregressive Textless Speech-to-Speech Translation

2024-06-11 · Qingkai Fang, Zhengrui Ma, Yan Zhou, Min Zhang 외

Direct speech-to-speech translation (S2ST) has achieved impressive translation quality, but it often faces the challenge of slow decoding due to the considerable length of speech sequences. Recently, some research has tu…

Knowledge DistillationMachine TranslationSpeech-to-Speech TranslationTranslation

The Volctrans GLAT System: Non-autoregressive Translation Meets WMT21

2021-09-23 · WMT (EMNLP) 2021 11 · Lihua Qian, Yi Zhou, Zaixiang Zheng, Yaoming Zhu 외

This paper describes the Volctrans' submission to the WMT21 news translation shared task for German->English translation. We build a parallel (i.e., non-autoregressive) translation system using the Glancing Transformer, …

Translation

Prediction Improves Simultaneous Neural Machine Translation

2018-10-01 · EMNLP 2018 10 · Ashkan Alinejad, Maryam Siahbani, Anoop Sarkar

Simultaneous speech translation aims to maintain translation quality while minimizing the delay between reading input and incrementally producing the output. We propose a new general-purpose prediction action which predi…

Machine TranslationPredictionreinforcement-learningReinforcement Learning+2