paper-with-me

Papers

Learning Interpretable Representation for Controllable Polyphonic Music Generation

2020-08-17 · Ziyu Wang, Dingsu Wang, Yixiao Zhang, Gus Xia

While deep generative models have become the leading methods for algorithmic composition, it remains a challenging problem to control the generation process because the latent variables of most deep-learning models lack good interpretability. Inspired by the content-style disentanglement idea, we design a novel architecture, under the VAE framework, that effectively learns two interpretable latent factors of polyphonic music: chord and texture. The current model focuses on learning 8-beat long piano composition segments. We show that such chord-texture disentanglement provides a controllable generation pathway leading to a wide spectrum of applications, including compositional style transfer, texture variation, and accompaniment arrangement. Both objective and subjective evaluations show that our method achieves a successful disentanglement and high quality controlled music generation.

📄 PDF Abstract BibTeX arXiv:2008.07122

Code (2)

ZZWaang/polyphonic-chord-texture-disentanglement 공식 구현 pytorch
zzwaang/audio2midi pytorch

Tasks

DisentanglementMusic GenerationStyle Transfer

Methods 이 논문이 사용한 방법론

USD Coin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

CoCoFormer: A controllable feature-rich polyphonic music generation method

2023-10-15 · Jiuyang Zhou, Tengfei Niu, Hong Zhu, Xingping Wang

This paper explores the modeling method of polyphonic music sequence. Due to the great potential of Transformer models in music generation, controllable music generation is receiving more attention. In the task of polyph…

DiversityMusic GenerationRhythm

Polyffusion: A Diffusion Model for Polyphonic Score Generation with Internal and External Controls

2023-07-19 · Lejun Min, Junyan Jiang, Gus Xia, Jingwei Zhao

We propose Polyffusion, a diffusion model that generates polyphonic music scores by regarding music as image-like piano roll representations. The model is capable of controllable music generation with two paradigms: inte…

Music Generation

Choir Transformer: Generating Polyphonic Music with Relative Attention on Transformer

2023-08-01 · Jiuyang Zhou, Hong Zhu, Xingping Wang

Polyphonic music generation is still a challenge direction due to its correct between generating melody and harmony. Most of the previous studies used RNN-based models. However, the RNN-based models are hard to establish…

Music GenerationRhythm

PIANOTREE VAE: Structured Representation Learning for Polyphonic Music

2020-08-17 · Ziyu Wang, Yiyi Zhang, Yixiao Zhang, Junyan Jiang 외

The dominant approach for music representation learning involves the deep unsupervised model family variational autoencoder (VAE). However, most, if not all, viable attempts on this problem have largely been limited to m…

Music GenerationRepresentation Learning

Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription

2012-06-27 · Nicolas Boulanger-Lewandowski, Yoshua Bengio, Pascal Vincent

We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurr…

Language ModelingLanguage ModellingMusic GenerationMusic Modeling