paper-with-me

홈 › Papers

Error Reduction Network for DBLSTM-based Voice Conversion

2018-09-26

So far, many of the deep learning approaches for voice conversion produce good quality speech by using a large amount of training data. This paper presents a Deep Bidirectional Long Short-Term Memory (DBLSTM) based voice conversion framework that can work with a limited amount of training data. We propose to implement a DBLSTM based average model that is trained with data from many speakers. Then, we propose to perform adaptation with a limited amount of target data. Last but not least, we propose an error reduction network that can improve the voice conversion quality even further. The proposed framework is motivated by three observations. Firstly, DBLSTM can achieve a remarkable voice conversion by considering the long-term dependencies of the speech utterance. Secondly, DBLSTM based average model can be easily adapted with a small amount of data, to achieve a speech that sounds closer to the target. Thirdly, an error reduction network can be trained with a small amount of training data, and can improve the conversion quality effectively. The experiments show that the proposed voice conversion framework is flexible to work with limited training data and outperforms the traditional frameworks in both objective and subjective evaluations.

📄 PDF Abstract BibTeX arXiv:1809.09841

Code (0)

등록된 구현이 없습니다.

Tasks

Voice Conversion

Similar Papers 제목 키워드 기반

Singing voice conversion with non-parallel data

2019-03-11 · Xin Chen, Wei Chu, Jinxi Guo, Ning Xu

Singing voice conversion is a task to convert a song sang by a source singer to the voice of a target singer. In this paper, we propose using a parallel data free, many-to-one voice conversion technique on singing voices…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

Unsupervised Rhythm and Voice Conversion to Improve ASR on Dysarthric Speech

2025-06-02 · Karl El Hajal, Enno Hermann, Sevada Hovsepyan, Mathew Magimai. -Doss

Automatic speech recognition (ASR) systems struggle with dysarthric speech due to high inter-speaker variability and slow speaking rates. To address this, we explore dysarthric-to-healthy speech conversion for improved A…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Rhythmspeech-recognition+2

Learning Explicit Prosody Models and Deep Speaker Embeddings for Atypical Voice Conversion

2020-11-03 · Disong Wang, Songxiang Liu, Lifa Sun, Xixin Wu 외

Though significant progress has been made for the voice conversion (VC) of typical speech, VC for atypical speech, e.g., dysarthric and second-language (L2) speech, remains a challenge, since it involves correcting for a…

speech-recognitionSpeech RecognitionVoice Conversion

RT-VC: Real-Time Zero-Shot Voice Conversion with Speech Articulatory Coding

2025-06-12 · Yisi Liu, Chenyang Wang, Hanjo Kim, Raniya Khan 외

Voice conversion has emerged as a pivotal technology in numerous applications ranging from assistive communication to entertainment. In this paper, we present RT-VC, a zero-shot real-time voice conversion system that del…

CPUVoice Conversion

FSD: An Initial Chinese Dataset for Fake Song Detection

2023-09-05 · Yuankun Xie, Jingjing Zhou, Xiaolin Lu, Zhenghao Jiang 외

Singing voice synthesis and singing voice conversion have significantly advanced, revolutionizing musical experiences. However, the rise of "Deepfake Songs" generated by these technologies raises concerns about authentic…

Audio Deepfake DetectionDeepFake DetectionFace SwappingFake Song Detection+2