paper-with-me

Papers

AE-Flow: AutoEncoder Normalizing Flow

2023-12-27 · Jakub Mosiński, Piotr Biliński, Thomas Merritt, Abdelhamid Ezzerg, Daniel Korzekwa

Recently normalizing flows have been gaining traction in text-to-speech (TTS) and voice conversion (VC) due to their state-of-the-art (SOTA) performance. Normalizing flows are unsupervised generative models. In this paper, we introduce supervision to the training process of normalizing flows, without the need for parallel data. We call this training paradigm AutoEncoder Normalizing Flow (AE-Flow). It adds a reconstruction loss forcing the model to use information from the conditioning to reconstruct an audio sample. Our goal is to understand the impact of each component and find the right combination of the negative log-likelihood (NLL) and the reconstruction loss in training normalizing flows with coupling blocks. For that reason we will compare flow-based mapping model trained with: (i) NLL loss, (ii) NLL and reconstruction losses, as well as (iii) reconstruction loss only. Additionally, we compare our model with SOTA VC baseline. The models are evaluated in terms of naturalness, speaker similarity, intelligibility in many-to-many and many-to-any VC settings. The results show that the proposed training paradigm systematically improves speaker similarity and naturalness when compared to regular training methods of normalizing flows. Furthermore, we show that our method improves speaker similarity and intelligibility over the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2312.16552

Code (0)

등록된 구현이 없습니다.

Tasks

text-to-speechText to SpeechVoice Conversion

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Generalized Normalizing Flows via Markov Chains

2021-11-24 · Paul Hagemann, Johannes Hertrich, Gabriele Steidl

Normalizing flows, diffusion normalizing flows and variational autoencoders are powerful generative models. This chapter provides a unified framework to handle these approaches via Markov chains. We consider stochastic n…

SurVAE Flows: Surjections to Bridge the Gap between VAEs and Flows

2020-07-06 · NeurIPS 2020 12 · Didrik Nielsen, Priyank Jaini, Emiel Hoogeboom, Ole Winther 외

Normalizing flows and variational autoencoders are powerful generative models that can represent complicated density functions. However, they both impose constraints on the models: Normalizing flows use bijective transfo…

Nonlinear Isometric Manifold Learning for Injective Normalizing Flows

2022-03-08 · Eike Cramer, Felix Rauh, Alexander Mitsos, Raúl Tempone 외

To model manifold data using normalizing flows, we employ isometric autoencoders to design embeddings with explicit inverses that do not distort the probability distribution. Using isometries separates manifold learning …

Density EstimationModel Selection

PNF: Progressive normalizing flows

2021-06-02 · Anonymous

In this work, we introduce Progressive Normalizing Flows (PNF), a generative network that allows to model high-dimensional input data distributions by progressively training several flow-based modules. Competing generati…

Variational Autoencoders with Normalizing Flow Decoders

2020-04-12 · Rogan Morrow, Wei-Chen Chiu

Recently proposed normalizing flow models such as Glow have been shown to be able to generate high quality, high dimensional images with relatively fast sampling speed. Due to their inherently restrictive architecture, h…