paper-with-me

Papers

Many-to-Many Voice Conversion using Conditional Cycle-Consistent Adversarial Networks

2020-02-15 · Shindong Lee, BongGu Ko, Keonnyeong Lee, In-Chul Yoo, Dongsuk Yook

Voice conversion (VC) refers to transforming the speaker characteristics of an utterance without altering its linguistic contents. Many works on voice conversion require to have parallel training data that is highly expensive to acquire. Recently, the cycle-consistent adversarial network (CycleGAN), which does not require parallel training data, has been applied to voice conversion, showing the state-of-the-art performance. The CycleGAN based voice conversion, however, can be used only for a pair of speakers, i.e., one-to-one voice conversion between two speakers. In this paper, we extend the CycleGAN by conditioning the network on speakers. As a result, the proposed method can perform many-to-many voice conversion among multiple speakers using a single generative adversarial network (GAN). Compared to building multiple CycleGANs for each pair of speakers, the proposed method reduces the computational and spatial cost significantly without compromising the sound quality of the converted voice. Experimental results using the VCC2018 corpus confirm the efficiency of the proposed method.

📄 PDF Abstract BibTeX arXiv:2002.06328

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial NetworkVoice Conversion

Methods 이 논문이 사용한 방법론

Batch Normalization 설명 없음
Residual Connection 설명 없음
PatchGAN 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Tanh Activation 설명 없음
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Many-to-Many Voice Conversion using Cycle-Consistent Variational Autoencoder with Multiple Decoders

2019-09-15 · Keonnyeong Lee, In-Chul Yoo, Dongsuk Yook

One of the obstacles in many-to-many voice conversion is the requirement of the parallel training data, which contain pairs of utterances with the same linguistic content spoken by different speakers. Since collecting su…

Voice Conversion

Many-to-Many Voice Conversion with Out-of-Dataset Speaker Support

2019-04-30 · Gokce Keskin, Tyler Lee, Cory Stephenson, Oguz H. Elibol

We present a Cycle-GAN based many-to-many voice conversion method that can convert between speakers that are not in the training set. This property is enabled through speaker embeddings generated by a neural network that…

Speaker IdentificationVoice Conversion

F0-consistent many-to-many non-parallel voice conversion via conditional autoencoder

2020-04-15 · Kaizhi Qian, Zeyu Jin, Mark Hasegawa-Johnson, Gautham J. Mysore

Non-parallel many-to-many voice conversion remains an interesting but challenging speech processing task. Many style-transfer-inspired methods such as generative adversarial networks (GANs) and variational autoencoders (…

Style TransferVoice Conversion

AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss

2019-05-14 · Kaizhi Qian, Yang Zhang, Shiyu Chang, Xuesong Yang 외

Non-parallel many-to-many voice conversion, as well as zero-shot voice conversion, remain under-explored areas. Deep style transfer algorithms, such as generative adversarial networks (GAN) and conditional variational au…

Style TransferVoice Conversion

Voice Conversion with Conditional SampleRNN

2018-08-24 · Cong Zhou, Michael Horgan, Vivek Kumar, Cristina Vasco 외

Here we present a novel approach to conditioning the SampleRNN generative model for voice conversion (VC). Conventional methods for VC modify the perceived speaker identity by converting between source and target acousti…

Voice Conversion