VaPar Synth -- A Variational Parametric Model for Audio Synthesis
With the advent of data-driven statistical modeling and abundant computing power, researchers are turning increasingly to deep learning for audio synthesis. These methods try to model audio signals directly in the time or frequency domain. In the interest of more flexible control over the generated sound, it could be more useful to work with a parametric representation of the signal which corresponds more directly to the musical attributes such as pitch, dynamics and timbre. We present VaPar Synth - a Variational Parametric Synthesizer which utilizes a conditional variational autoencoder (CVAE) trained on a suitable parametric representation. We demonstrate our proposed model's capabilities via the reconstruction and generation of instrumental tones with flexible control over their pitch.
Code (1)
Tasks
Audio SynthesisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HpRNet : Incorporating Residual Noise Modeling for Violin in a Variational Parametric Synthesizer
Generative Models for Audio Synthesis have been gaining momentum in the last few years. More recently, parametric representations of the audio signal have been incorporated to facilitate better musical control of the syn…
Audio SynthesisReal-valued parametric conditioning of an RNN for interactive sound synthesis
A Recurrent Neural Network (RNN) for audio synthesis is trained by augmenting the audio input with information about signal characteristics such as pitch, amplitude, and instrument. The result after training is an audio …
Audio SynthesisGenerative Audio Synthesis with a Parametric Model
Use a parametric representation of audio to train a generative model in the interest of obtaining more flexible control over the generated sound.
Audio SynthesismodelConditional variational autoencoder to improve neural audio synthesis for polyphonic music sound
Deep generative models for audio synthesis have recently been significantly improved. However, the task of modeling raw-waveforms remains a difficult problem, especially for audio waveforms and music signals. Recently, t…
Audio SynthesisRAVE: A variational autoencoder for fast and high-quality neural audio synthesis
Deep generative models applied to audio have improved by a large margin the state-of-the-art in many speech and music related tasks. However, as raw waveform modelling remains an inherently difficult task, audio generati…
Audio SynthesisCPURepresentation Learning