paper-with-me

Papers

StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning

2024-06-05 · Shaolei Zhang, Qingkai Fang, Shoutao Guo, Zhengrui Ma, Min Zhang, Yang Feng

Simultaneous speech-to-speech translation (Simul-S2ST, a.k.a streaming speech translation) outputs target speech while receiving streaming speech inputs, which is critical for real-time communication. Beyond accomplishing translation between speech, Simul-S2ST requires a policy to control the model to generate corresponding target speech at the opportune moment within speech inputs, thereby posing a double challenge of translation and policy. In this paper, we propose StreamSpeech, a direct Simul-S2ST model that jointly learns translation and simultaneous policy in a unified framework of multi-task learning. Adhering to a multi-task learning approach, StreamSpeech can perform offline and simultaneous speech recognition, speech translation and speech synthesis via an "All-in-One" seamless model. Experiments on CVSS benchmark demonstrate that StreamSpeech achieves state-of-the-art performance in both offline S2ST and Simul-S2ST tasks. Besides, StreamSpeech is able to present high-quality intermediate results (i.e., ASR or translation results) during simultaneous translation process, offering a more comprehensive real-time communication experience.

📄 PDF Abstract BibTeX arXiv:2406.03049

Code (1)

ictnlp/streamspeech 공식 구현 pytorch

Tasks

Automatic Speech Recognition (ASR)de-enes-enfr-enMachine TranslationMulti-Task LearningSimultaneous Speech-to-Speech TranslationSimultaneous Speech-to-Text Translationspeech-recognitionSpeech RecognitionSpeech SynthesisSpeech-to-Speech TranslationSpeech-to-Text TranslationText-To-Speech SynthesisTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
HiFi-GAN HiFi-GAN is a generative adversarial network for speech synthesis. HiFi-GAN consists of one generator and two discriminators: multi-scale and multi-period discriminators. The…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

SimulSpeech: End-to-End Simultaneous Speech to Text Translation

2020-07-01 · ACL 2020 6 · Yi Ren, Jinglin Liu, Xu Tan, Chen Zhang 외

In this work, we develop SimulSpeech, an end-to-end simultaneous speech to text translation system which translates speech in source language to text in target language concurrently. SimulSpeech consists of a speech enco…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderKnowledge Distillation+9

Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention

2021-10-15 · Xutai Ma, Hongyu Gong, Danni Liu, Ann Lee 외

We present a direct simultaneous speech-to-speech translation (Simul-S2ST) model, Furthermore, the generation of translation is independent from intermediate text representations. Our approach leverages recent progress o…

Simultaneous Speech-to-Speech TranslationSpeech SynthesisSpeech-to-Speech TranslationTranslation

High-Fidelity Simultaneous Speech-To-Speech Translation

2025-02-05 · Tom Labiausse, Laurent Mazaré, Edouard Grave, Patrick Pérez 외

We introduce Hibiki, a decoder-only model for simultaneous speech translation. Hibiki leverages a multistream language model to synchronously process source and target speech, and jointly produces text and audio tokens t…

DecoderSimultaneous Speech-to-Speech TranslationSpeech-to-Speech TranslationSpeech-to-Text+1

ON-TRAC Consortium for End-to-End and Simultaneous Speech Translation Challenge Tasks at IWSLT 2020

2020-05-24 · WS 2020 7 · Maha Elbayad, Ha Nguyen, Fethi Bougares, Natalia Tomashenko 외

This paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2020, offline speech translation and simultaneous speech translation. ON-TRA…

Data AugmentationDecoderSpeech-to-TextTranslation

A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Speech Translation

2024-06-11 · Zhengrui Ma, Qingkai Fang, Shaolei Zhang, Shoutao Guo 외

Simultaneous translation models play a crucial role in facilitating communication. However, existing research primarily focuses on text-to-text or speech-to-text models, necessitating additional cascade components to ach…

DecoderSimultaneous Speech-to-Speech TranslationSpeech-to-Speech TranslationSpeech-to-Text+1