paper-with-me

홈 › Papers

Boosting Star-GANs for Voice Conversion with Contrastive Discriminator

2022-09-21 · Shijing Si, Jianzong Wang, xulong Zhang, Xiaoyang Qu, Ning Cheng, Jing Xiao

Nonparallel multi-domain voice conversion methods such as the StarGAN-VCs have been widely applied in many scenarios. However, the training of these models usually poses a challenge due to their complicated adversarial network architectures. To address this, in this work we leverage the state-of-the-art contrastive learning techniques and incorporate an efficient Siamese network structure into the StarGAN discriminator. Our method is called SimSiam-StarGAN-VC and it boosts the training stability and effectively prevents the discriminator overfitting issue in the training process. We conduct experiments on the Voice Conversion Challenge (VCC 2018) dataset, plus a user study to validate the performance of our framework. Our experimental results show that SimSiam-StarGAN-VC significantly outperforms existing StarGAN-VC methods in terms of both the objective and subjective metrics.

📄 PDF Abstract BibTeX arXiv:2209.10088

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningVoice Conversion

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
Siamese Network 설명 없음

Similar Papers 제목 키워드 기반

StarGAN-ZSVC: Towards Zero-Shot Voice Conversion in Low-Resource Contexts

2021-05-31 · Matthew Baas, Herman Kamper

Voice conversion is the task of converting a spoken utterance from a source speaker so that it appears to be said by a different target speaker while retaining the linguistic content of the utterance. Recent advances hav…

Voice Conversion

StarGAN-VC: Non-parallel many-to-many voice conversion with star generative adversarial networks

2018-06-06 · Hirokazu Kameoka, Takuhiro Kaneko, Kou Tanaka, Nobukatsu Hojo

This paper proposes a method that allows non-parallel many-to-many voice conversion (VC) by using a variant of a generative adversarial network (GAN) called StarGAN. Our method, which we call StarGAN-VC, is noteworthy in…

AttributeGenerative Adversarial NetworkVoice Conversion

SLMGAN: Exploiting Speech Language Model Representations for Unsupervised Zero-Shot Voice Conversion in GANs

2023-07-18 · Yinghao Aaron Li, Cong Han, Nima Mesgarani

In recent years, large-scale pre-trained speech language models (SLMs) have demonstrated remarkable advancements in various generative speech modeling applications, such as text-to-speech synthesis, voice conversion, and…

Generative Adversarial NetworkLanguage ModelingLanguage ModellingSpeech Enhancement+5

Nonparallel Voice Conversion with Augmented Classifier Star Generative Adversarial Networks

2020-08-27 · Hirokazu Kameoka, Takuhiro Kaneko, Kou Tanaka, Nobukatsu Hojo

We previously proposed a method that allows for nonparallel voice conversion (VC) by using a variant of generative adversarial networks (GANs) called StarGAN. The main features of our method, called StarGAN-VC, are as fo…

Voice Conversion

StarGANv2-VC: A Diverse, Unsupervised, Non-parallel Framework for Natural-Sounding Voice Conversion

2021-07-21 · Yinghao Aaron Li, Ali Zare, Nima Mesgarani

We present an unsupervised non-parallel many-to-many voice conversion (VC) method using a generative adversarial network (GAN) called StarGAN v2. Using a combination of adversarial source classifier loss and perceptual l…

Generative Adversarial Networktext-to-speechText to SpeechVoice Conversion