Parallel Neural Text-to-Speech

2020-01-01 · ICLR 2020 1 · Kainan Peng, Wei Ping, Zhao Song, Kexin Zhao

In this work, we first propose ParaNet, a non-autoregressive seq2seq model that converts text to spectrogram. It is fully convolutional and obtains 46.7 times speed-up over Deep Voice 3 at synthesis while maintaining comparable speech quality using a WaveNet vocoder. ParaNet also produces stable alignment between text and speech on the challenging test sentences by iteratively improving the attention in a layer-by-layer manner. Based on ParaNet, we build the first fully parallel neural text-to-speech system using parallel neural vocoders, which can synthesize speech from text through a single feed-forward pass. We investigate several parallel vocoders within the TTS system, including variants of IAF vocoders and bipartite flow vocoder.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

text-to-speech Text to Speech

Methods 이 논문이 사용한 방법론

Test 설명 없음

Attention 설명 없음

Weight Normalization Weight Normalization is a normalization method for training neural networks. It is inspired by batch normalization,…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

L1 Regularization $L_{1}$ Regularization is a regularization technique applied to the weights of a neural network. We minimize a loss function compromising both the primary loss function and a…

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Softsign Activation Softsign is an activation function for neural networks: $$ f\left(x\right) = \left(\frac{x}{|x|+1}\right)$$ Image Source: [Sefik Ilkin…

Residual Connection 설명 없음

Textless Speech-to-Speech Translation With Limited Parallel Data

2023-05-24 · Anuj Diwan, Anirudh Srinivasan, David Harwath, Eunsol Choi

Existing speech-to-speech translation (S2ST) models fall into two camps: they either leverage text as an intermediate step or require hundreds of hours of parallel speech data. Both approaches are incompatible with textl…

Automatic Speech Recognition Denoising Language Modelling Machine Translation+4

OmniDRCA: Parallel Speech-Text Foundation Model via Dual-Resolution Speech Representations and Contrastive Alignment

2025-06-11 · Chao-Hong Tan, Qian Chen, Wen Wang, Chong Deng 외

Recent studies on end-to-end speech generation with large language models (LLMs) have attracted significant community attention, with multiple works extending text-based LLMs to generate discrete speech tokens. Existing …

cross-modal alignment Question Answering Speech Synthesis Text Generation

Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data?

2024-06-11 · Qingkai Fang, Shaolei Zhang, Zhengrui Ma, Min Zhang 외

Recently proposed two-pass direct speech-to-speech translation (S2ST) models decompose the task into speech-to-text translation (S2TT) and text-to-speech (TTS) within an end-to-end model, yielding promising results. Howe…

Contrastive Learning Speech Synthesis Speech-to-Speech Translation Speech-to-Text+5

Non-Autoregressive Neural Text-to-Speech

2019-05-21 · ICML 2020 1 · Kainan Peng, Wei Ping, Zhao Song, Kexin Zhao

In this work, we propose ParaNet, a non-autoregressive seq2seq model that converts text to spectrogram. It is fully convolutional and brings 46.7 times speed-up over the lightweight Deep Voice 3 at synthesis, while obtai…

text-to-speech Text to Speech Text-To-Speech Synthesis

POTSA: A Cross-Lingual Speech Alignment Framework for Speech-to-Text Translation

2025-11-12 · Xuanchen Li, Chenrui Cui, Tianrui Wang, Meng Ge 외 arxiv

Speech Large Language Models have achieved breakthroughs in multilingual speech-to-text translation. However, existing approaches often overlook semantic commonalities across source languages, leading to biased translati…

Speech-to-Text Translation