paper-with-me

Papers

Hierarchical Diffusion Models for Singing Voice Neural Vocoder

2022-10-14 · Naoya Takahashi, Mayank Kumar, Singh, Yuki Mitsufuji

Recent progress in deep generative models has improved the quality of neural vocoders in speech domain. However, generating a high-quality singing voice remains challenging due to a wider variety of musical expressions in pitch, loudness, and pronunciations. In this work, we propose a hierarchical diffusion model for singing voice neural vocoders. The proposed method consists of multiple diffusion models operating in different sampling rates; the model at the lowest sampling rate focuses on generating accurate low-frequency components such as pitch, and other models progressively generate the waveform at higher sampling rates on the basis of the data at the lower sampling rate and acoustic features. Experimental results show that the proposed method produces high-quality singing voices for multiple singers, outperforming state-of-the-art neural vocoders with a similar range of computational costs.

📄 PDF Abstract BibTeX arXiv:2210.07508

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Mandarin Singing Voice Synthesis with Denoising Diffusion Probabilistic Wasserstein GAN

2022-09-21 · Yin-Ping Cho, Yu Tsao, Hsin-Min Wang, Yi-Wen Liu

Singing voice synthesis (SVS) is the computer production of a human-like singing voice from given musical scores. To accomplish end-to-end SVS effectively and efficiently, this work adopts the acoustic model-neural vocod…

DenoisingGenerative Adversarial NetworkSinging Voice Synthesis

Adversarial Multi-Task Learning for Disentangling Timbre and Pitch in Singing Voice Synthesis

2022-06-23 · Tae-Woo Kim, Min-Su Kang, Gyeong-Hoon Lee

Recently, deep learning-based generative models have been introduced to generate singing voices. One approach is to predict the parametric vocoder features consisting of explicit speech parameters. This approach has the …

Generative Adversarial NetworkMulti-Task LearningSinging Voice Synthesis

Robust One-Shot Singing Voice Conversion

2022-10-20 · Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji

Recent progress in deep generative models has improved the quality of voice conversion in the speech domain. However, high-quality singing voice conversion (SVC) of unseen singers remains challenging due to the wider var…

Voice Conversion

Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpus

2021-12-20 · MM '21: Proceedings of the 29th ACM International Conference on Multimedia 2021 10 · Rongjie Huang, Feiyang Chen, Yi Ren, Jinglin Liu 외

High-fidelity multi-singer singing voice synthesis is challenging for neural vocoder due to the singing voice data shortage, limited singer generalization, and large computational cost. Existing open corpora could not me…

Audio GenerationSinging Voice SynthesisText-To-Speech Synthesis

Sinsy: A Deep Neural Network-Based Singing Voice Synthesis System

2021-08-05 · Yukiya Hono, Kei Hashimoto, Keiichiro Oura, Yoshihiko Nankaku 외

This paper presents Sinsy, a deep neural network (DNN)-based singing voice synthesis (SVS) system. In recent years, DNNs have been utilized in statistical parametric SVS systems, and DNN-based SVS systems have demonstrat…

Singing Voice Synthesis