paper-with-me

홈 › Papers

GenVC: Self-Supervised Zero-Shot Voice Conversion

2025-02-06 · Zexin Cai, Henry Li Xinyuan, Ashi Garg, Leibny Paola García-Perera, Kevin Duh, Sanjeev Khudanpur, Matthew Wiesner, Nicholas Andrews

Zero-shot voice conversion has recently made substantial progress, but many models still depend on external supervised systems to disentangle speaker identity and linguistic content. Furthermore, current methods often use parallel conversion, where the converted speech inherits the source utterance's temporal structure, restricting speaker similarity and privacy. To overcome these limitations, we introduce GenVC, a generative zero-shot voice conversion model. GenVC learns to disentangle linguistic content and speaker style in a self-supervised manner, eliminating the need for external models and enabling efficient training on large, unlabeled datasets. Experimental results show that GenVC achieves state-of-the-art speaker similarity while maintaining naturalness competitive with leading approaches. Its autoregressive generation also allows the converted speech to deviate from the source utterance's temporal structure. This feature makes GenVC highly effective for voice anonymization, as it minimizes the preservation of source prosody and speaker characteristics, enhancing privacy protection.

📄 PDF Abstract BibTeX arXiv:2502.04519

Code (0)

등록된 구현이 없습니다.

Tasks

Voice Conversion

Similar Papers 제목 키워드 기반

EZ-VC: Easy Zero-shot Any-to-Any Voice Conversion

2025-05-22 · Advait Joglekar, Divyanshu Singh, Rooshil Rohit Bhatia, S. Umesh

Voice Conversion research in recent times has increasingly focused on improving the zero-shot capabilities of existing methods. Despite remarkable advancements, current architectures still tend to struggle in zero-shot c…

DecoderVoice Conversion

Zero-shot Voice Conversion via Self-supervised Prosody Representation Learning

2021-10-27 · Shijun Wang, Dimche Kostadinov, Damian Borth

Voice Conversion (VC) for unseen speakers, also known as zero-shot VC, is an attractive research topic as it enables a range of applications like voice customizing, animation production, and others. Recent work in this a…

DisentanglementRepresentation LearningVoice Conversion

Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglement

2025-02-11 · Xueyao Zhang, Xiaohui Zhang, Kainan Peng, Zhenyu Tang 외

The imitation of voice, targeted on specific speech attributes such as timbre and speaking style, is crucial in speech generation. However, existing methods rely heavily on annotated data, and struggle with effectively d…

Disentanglementtext-to-speechText to SpeechVoice Conversion

HierVST: Hierarchical Adaptive Zero-shot Voice Style Transfer

2023-07-30 · Sang-Hoon Lee, Ha-Yeong Choi, Hyung-Seok Oh, Seong-Whan Lee

Despite rapid progress in the voice style transfer (VST) field, recent zero-shot VST systems still lack the ability to transfer the voice style of a novel speaker. In this paper, we present HierVST, a hierarchical adapti…

Style TransferVariational Inference

Discl-VC: Disentangled Discrete Tokens and In-Context Learning for Controllable Zero-Shot Voice Conversion

2025-05-30 · Kaidi Wang, Wenhao Guan, Ziyue Jiang, Hukai Huang 외

Currently, zero-shot voice conversion systems are capable of synthesizing the voice of unseen speakers. However, most existing approaches struggle to accurately replicate the speaking style of the source speaker or mimic…

In-Context LearningVoice Conversion