Conditioning Autoencoder Latent Spaces for Real-Time Timbre Interpolation and Synthesis
We compare standard autoencoder topologies' performances for timbre generation. We demonstrate how different activation functions used in the autoencoder's bottleneck distributes a training corpus's embedding. We show that the choice of sigmoid activation in the bottleneck produces a more bounded and uniformly distributed embedding than a leaky rectified linear unit activation. We propose a one-hot encoded chroma feature vector for use in both input augmentation and latent space conditioning. We measure the performance of these networks, and characterize the latent embeddings that arise from the use of this chroma conditioning vector. An open source, real-time timbre synthesis algorithm in Python is outlined and shared.
Code (0)
등록된 구현이 없습니다.
Tasks
Timbre InterpolationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MRExtrap: Longitudinal Aging of Brain MRIs using Linear Modeling in Latent Space
Simulating aging in 3D brain MRI scans can reveal disease progression patterns in neurological disorders such as Alzheimer's disease. Current deep learning-based generative models typically approach this problem by predi…
Improved Anomaly Detection through Conditional Latent Space VAE Ensembles
We propose a novel Conditional Latent space Variational Autoencoder (CL-VAE) to perform improved pre-processing for anomaly detection on data with known inlier classes and unknown outlier classes. This proposed variation…
Anomaly DetectionEvidential Sparsification of Multimodal Latent Spaces in Conditional Variational Autoencoders
Discrete latent spaces in variational autoencoders have been shown to effectively capture the data distribution for many real-world problems such as natural language understanding, human intent prediction, and visual sce…
Image GenerationMotion PlanningNatural Language UnderstandingCAESynth: Real-Time Timbre Interpolation and Pitch Control with Conditional Autoencoders
In this paper, we present a novel audio synthesizer, CAESynth, based on a conditional autoencoder. CAESynth synthesizes timbre in real-time by interpolating the reference sounds in their shared latent feature space, whil…
Audio SynthesisMixed RealityPitch controlTimbre InterpolationMultimodal hierarchical Variational AutoEncoders with Factor Analysis latent space
Purpose: Handling heterogeneous and mixed data types has become increasingly critical with the exponential growth in real-world databases. While deep generative models attempt to merge diverse data views into a common la…
Transfer Learning