Differentiable Wavetable Synthesis
Differentiable Wavetable Synthesis (DWTS) is a technique for neural audio synthesis which learns a dictionary of one-period waveforms i.e. wavetables, through end-to-end training. We achieve high-fidelity audio synthesis with as little as 10 to 20 wavetables and demonstrate how a data-driven dictionary of waveforms opens up unprecedented one-shot learning paradigms on short audio clips. Notably, we show audio manipulations, such as high quality pitch-shifting, using only a few seconds of input audio. Lastly, we investigate performance gains from using learned wavetables for realtime and interactive audio synthesis.
Code (1)
Tasks
Audio SynthesisOne-Shot LearningSimilar Papers 제목 키워드 기반
Wavetable Synthesis Using CVAE for Timbre Control Based on Semantic Label
Synthesizers are essential in modern music production. However, their complex timbre parameters, often filled with technical terms, require expertise. This research introduces a method of timbre control in wavetable synt…
Singing Voice Synthesis Using Differentiable LPC and Glottal-Flow-Inspired Wavetables
This paper introduces GlOttal-flow LPC Filter (GOLF), a novel method for singing voice synthesis (SVS) that exploits the physical characteristics of the human voice using differentiable digital signal processing. GOLF em…
Singing Voice SynthesisNeural Wavetable: a playable wavetable synthesizer using neural networks
We present Neural Wavetable, a proof-of-concept wavetable synthesizer that uses neural networks to generate playable wavetables. The system can produce new, distinct waveforms through the interpolation of traditional wav…
SonOpt: Sonifying Bi-objective Population-Based Optimization Algorithms
We propose SonOpt, the first (open source) data sonification application for monitoring the progress of bi-objective population-based optimization algorithms during search, to facilitate algorithm understanding. SonOpt p…
DiversityDDX7: Differentiable FM Synthesis of Musical Instrument Sounds
FM Synthesis is a well-known algorithm used to generate complex timbre from a compact set of design primitives. Typically featuring a MIDI interface, it is usually impractical to control it from an audio source. On the o…
continuous-controlContinuous ControlResynthesisSpectral Reconstruction