paper-with-me

홈 › Papers

N-Singer: A Non-Autoregressive Korean Singing Voice Synthesis System for Pronunciation Enhancement

2021-06-29 · Gyeong-Hoon Lee, Tae-Woo Kim, Hanbin Bae, Min-Ji Lee, Young-Ik Kim, Hoon-Young Cho

Recently, end-to-end Korean singing voice systems have been designed to generate realistic singing voices. However, these systems still suffer from a lack of robustness in terms of pronunciation accuracy. In this paper, we propose N-Singer, a non-autoregressive Korean singing voice system, to synthesize accurate and pronounced Korean singing voices in parallel. N-Singer consists of a Transformer-based mel-generator, a convolutional network-based postnet, and voicing-aware discriminators. It can contribute in the following ways. First, for accurate pronunciation, N-Singer separately models linguistic and pitch information without other acoustic features. Second, to achieve improved mel-spectrograms, N-Singer uses a combination of Transformer-based modules and convolutional network-based modules. Third, in adversarial training, voicing-aware conditional discriminators are used to capture the harmonic features of voiced segments and noise components of unvoiced segments. The experimental results prove that N-Singer can synthesize a natural singing voice in parallel with a more accurate pronunciation than the baseline model.

📄 PDF Abstract BibTeX arXiv:2106.15205

Code (0)

등록된 구현이 없습니다.

Tasks

Singing Voice Synthesis

Similar Papers 제목 키워드 기반

MLP Singer: Towards Rapid Parallel Singing Voice Synthesis

2021-06-15 · arXiv 2021 6 · Jaesung Tae, Hyeongju Kim, Younggun Lee

Recent developments in deep learning have significantly improved the quality of synthesized singing voice audio. However, prominent neural singing voice synthesis systems suffer from slow inference speed due to their aut…

image-classificationSinging Voice Synthesis

Period Singer: Integrating Periodic and Aperiodic Variational Autoencoders for Natural-Sounding End-to-End Singing Voice Synthesis

2024-06-14 · Taewoo Kim, Choongsang Cho, Young Han Lee

In this paper, we present Period Singer, a novel end-to-end singing voice synthesis (SVS) model that utilizes variational inference for periodic and aperiodic components, aimed at producing natural-sounding waveforms. Re…

Singing Voice SynthesisVariational Inference

Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpus

2021-12-20 · MM '21: Proceedings of the 29th ACM International Conference on Multimedia 2021 10 · Rongjie Huang, Feiyang Chen, Yi Ren, Jinglin Liu 외

High-fidelity multi-singer singing voice synthesis is challenging for neural vocoder due to the singing voice data shortage, limited singer generalization, and large computational cost. Existing open corpora could not me…

Audio GenerationSinging Voice SynthesisText-To-Speech Synthesis

Mitigating Latent Mismatch in cVAE-Based Singing Voice Synthesis via Flow Matching

2026-01-01 · Minhyeok Yun, Yong-Hoon Choi arxiv

Singing voice synthesis (SVS) aims to generate natural and expressive singing waveforms from symbolic musical scores. In cVAE-based SVS, however, a mismatch arises because the decoder is trained with latent representatio…

DeepSinger: Singing Voice Synthesis with Data Mined From the Web

2020-07-09 · Yi Ren, Xu Tan, Tao Qin, Jian Luan 외

In this paper, we develop DeepSinger, a multi-lingual multi-singer singing voice synthesis (SVS) system, which is built from scratch using singing training data mined from music websites. The pipeline of DeepSinger consi…

SentenceSinging Voice Synthesis