paper-with-me

홈 › Papers

Full-Sentence Models Perform Better in Simultaneous Translation Using the Information Enhanced Decoding Strategy

2021-05-05 · Zhengxin Yang

Simultaneous translation, which starts translating each sentence after receiving only a few words in source sentence, has a vital role in many scenarios. Although the previous prefix-to-prefix framework is considered suitable for simultaneous translation and achieves good performance, it still has two inevitable drawbacks: the high computational resource costs caused by the need to train a separate model for each latency $k$ and the insufficient ability to encode information because each target token can only attend to a specific source prefix. We propose a novel framework that adopts a simple but effective decoding strategy which is designed for full-sentence models. Within this framework, training a single full-sentence model can achieve arbitrary given latency and save computational resources. Besides, with the competence of the full-sentence model to encode the whole sentence, our decoding strategy can enhance the information maintained in the decoded states in real time. Experimental results show that our method achieves better translation quality than baselines on 4 directions: Zh$\rightarrow$En, En$\rightarrow$Ro and En$\leftrightarrow$De.

📄 PDF Abstract BibTeX arXiv:2105.01893

Code (0)

등록된 구현이 없습니다.

Tasks

SentenceTranslation

Similar Papers 제목 키워드 기반

BIT’s system for AutoSimulTrans2021

2021-06-01 · NAACL (AutoSimTrans) 2021 6 · Mengge Liu, Shuoying Chen, Minqin Li, Zhipeng Wang 외

In this paper we introduce our Chinese-English simultaneous translation system participating in AutoSimulTrans2021. In simultaneous translation, translation quality and delay are both important. In order to reduce the tr…

Domain AdaptationSentenceTranslation

Improving Simultaneous Translation by Incorporating Pseudo-References with Fewer Reorderings

2020-10-21 · EMNLP 2021 11 · Junkun Chen, Renjie Zheng, Atsuhito Kita, Mingbo Ma 외

Simultaneous translation is vastly different from full-sentence translation, in the sense that it starts translation before the source sentence ends, with only a few words delay. However, due to the lack of large-scale, …

SentenceTranslation

Monotonic Simultaneous Translation with Chunk-wise Reordering and Refinement

2021-10-18 · WMT (EMNLP) 2021 11 · Hyojung Han, Seokchan Ahn, Yoonjung Choi, Insoo Chung 외

Recent work in simultaneous machine translation is often trained with conventional full sentence translation corpora, leading to either excessive latency or necessity to anticipate as-yet-unarrived words, when dealing wi…

Machine TranslationSentenceTranslationWord Alignment

STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework

2018-10-19 · ACL 2019 7 · Mingbo Ma, Liang Huang, Hao Xiong, Renjie Zheng 외

Simultaneous translation, which translates sentences before they are finished, is useful in many scenarios but is notoriously difficult due to word-order differences. While the conventional seq-to-seq framework is only s…

de-enSentenceTranslation

SimulSpeech: End-to-End Simultaneous Speech to Text Translation

2020-07-01 · ACL 2020 6 · Yi Ren, Jinglin Liu, Xu Tan, Chen Zhang 외

In this work, we develop SimulSpeech, an end-to-end simultaneous speech to text translation system which translates speech in source language to text in target language concurrently. SimulSpeech consists of a speech enco…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderKnowledge Distillation+9