E1 TTS: Simple and Fast Non-Autoregressive TTS

2024-09-14 · Zhijun Liu, Shuai Wang, Pengcheng Zhu, Mengxiao Bi, Haizhou Li

This paper introduces Easy One-Step Text-to-Speech (E1 TTS), an efficient non-autoregressive zero-shot text-to-speech system based on denoising diffusion pretraining and distribution matching distillation. The training of E1 TTS is straightforward; it does not require explicit monotonic alignment between the text and audio pairs. The inference of E1 TTS is efficient, requiring only one neural network evaluation for each utterance. Despite its sampling efficiency, E1 TTS achieves naturalness and speaker similarity comparable to various strong baseline models. Audio samples are available at http://e1tts.github.io/ .

📄 PDF Abstract BibTeX arXiv:2409.09351

Code (0)

등록된 구현이 없습니다.

Tasks

Denoising text-to-speech Text to Speech

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

MADE: Masked Autoencoder for Distribution Estimation

2015-02-12 · Mathieu Germain, Karol Gregor, Iain Murray, Hugo Larochelle

There has been a lot of recent interest in designing neural network models to estimate a distribution from a set of examples. We introduce a simple modification for autoencoder neural networks that yields powerful genera…

Density Estimation Image Generation

Transformer-based Double-token Bidirectional Autoregressive Decoding in Neural Machine Translation

2020-12-01 · AACL (WAT) 2020 12 · Kenji Imamura, Eiichiro Sumita

This paper presents a simple method that extends a standard Transformer-based autoregressive decoder, to speed up decoding. The proposed method generates a token from the head and tail of a sentence (two tokens in total)…

Decoder Machine Translation Sentence Translation

One TTS Alignment To Rule Them All

2021-08-23 · Rohan Badlani, Adrian Łancucki, Kevin J. Shih, Rafael Valle 외

Speech-to-text alignment is a critical component of neural textto-speech (TTS) models. Autoregressive TTS models typically use an attention mechanism to learn these alignments on-line. However, these alignments tend to b…

All Speech Synthesis Speech-to-Text

Mixtures of Sparse Autoregressive Networks

2015-11-15 · Marc Goessling, Yali Amit

We consider high-dimensional distribution estimation through autoregressive networks. By combining the concepts of sparsity, mixtures and parameter sharing we obtain a simple model which is fast to train and which achiev…

Less Is More: Generating Time Series with LLaMA-Style Autoregression in Simple Factorized Latent Spaces

2025-11-07 · Siyuan Li, Yifan Sun, Lei Cheng, Lewen Wang 외 arxiv

Generative models for multivariate time series are essential for data augmentation, simulation, and privacy preservation, yet current state-of-the-art diffusion-based approaches are slow and limited to fixed-length windo…

Data Augmentation