Encoding Musical Style with Transformer Autoencoders
We consider the problem of learning high-level controls over the global structure of generated sequences, particularly in the context of symbolic music generation with complex language models. In this work, we present the Transformer autoencoder, which aggregates encodings of the input data across time to obtain a global representation of style from a given performance. We show it is possible to combine this global representation with other temporally distributed embeddings, enabling improved control over the separate aspects of performance style and melody. Empirically, we demonstrate the effectiveness of our method on various music generation tasks on the MAESTRO dataset and a YouTube dataset with 10,000+ hours of piano performances, where we achieve improvements in terms of log-likelihood and mean listening scores as compared to baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Music GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning and Evaluating Musical Features with Deep Autoencoders
In this work we describe and evaluate methods to learn musical embeddings. Each embedding is a vector that represents four contiguous beats of music and is derived from a symbolic representation. We consider autoencoding…
DenoisingGeneral ClassificationMuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAE
Transformers and variational autoencoders (VAE) have been extensively employed for symbolic (e.g., MIDI) domain music generation. While the former boast an impressive capability in modeling long sequences, the latter all…
DecoderMusic GenerationMusic Style TransferStyle TransferLearning Style-Aware Symbolic Music Representations by Adversarial Autoencoders
We address the challenging open problem of learning an effective latent space for symbolic music data in generative music modeling. We focus on leveraging adversarial regularization as a flexible and natural mean to imbu…
Music ModelingImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinement
Despite deep learning's remarkable advances in style transfer across various domains, generating controllable performance-level musical style transfer for complete symbolically represented musical works remains a challen…
Music GenerationRhythmStyle TransferDiscovering "Words" in Music: Unsupervised Learning of Compositional Sparse Code for Symbolic Music
This paper presents an unsupervised machine learning algorithm that identifies recurring patterns -- referred to as ``music-words'' -- from symbolic music data. These patterns are fundamental to musical structure and ref…
Music GenerationStyle Transfer