Learning Interpretable Representation for Controllable Polyphonic Music Generation
While deep generative models have become the leading methods for algorithmic composition, it remains a challenging problem to control the generation process because the latent variables of most deep-learning models lack good interpretability. Inspired by the content-style disentanglement idea, we design a novel architecture, under the VAE framework, that effectively learns two interpretable latent factors of polyphonic music: chord and texture. The current model focuses on learning 8-beat long piano composition segments. We show that such chord-texture disentanglement provides a controllable generation pathway leading to a wide spectrum of applications, including compositional style transfer, texture variation, and accompaniment arrangement. Both objective and subjective evaluations show that our method achieves a successful disentanglement and high quality controlled music generation.
Code (2)
Tasks
DisentanglementMusic GenerationStyle TransferMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CoCoFormer: A controllable feature-rich polyphonic music generation method
This paper explores the modeling method of polyphonic music sequence. Due to the great potential of Transformer models in music generation, controllable music generation is receiving more attention. In the task of polyph…
DiversityMusic GenerationRhythmPolyffusion: A Diffusion Model for Polyphonic Score Generation with Internal and External Controls
We propose Polyffusion, a diffusion model that generates polyphonic music scores by regarding music as image-like piano roll representations. The model is capable of controllable music generation with two paradigms: inte…
Music GenerationChoir Transformer: Generating Polyphonic Music with Relative Attention on Transformer
Polyphonic music generation is still a challenge direction due to its correct between generating melody and harmony. Most of the previous studies used RNN-based models. However, the RNN-based models are hard to establish…
Music GenerationRhythmPIANOTREE VAE: Structured Representation Learning for Polyphonic Music
The dominant approach for music representation learning involves the deep unsupervised model family variational autoencoder (VAE). However, most, if not all, viable attempts on this problem have largely been limited to m…
Music GenerationRepresentation LearningModeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription
We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurr…
Language ModelingLanguage ModellingMusic GenerationMusic Modeling