paper-with-me

홈 › Papers

A Classifying Variational Autoencoder with Application to Polyphonic Music Generation

2017-11-19 · Jay A. Hennig, Akash Umakantha, Ryan C. Williamson

The variational autoencoder (VAE) is a popular probabilistic generative model. However, one shortcoming of VAEs is that the latent variables cannot be discrete, which makes it difficult to generate data from different modes of a distribution. Here, we propose an extension of the VAE framework that incorporates a classifier to infer the discrete class of the modeled data. To model sequential data, we can combine our Classifying VAE with a recurrent neural network such as an LSTM. We apply this model to algorithmic music generation, where our model learns to generate musical sequences in different keys. Most previous work in this area avoids modeling key by transposing data into only one or two keys, as opposed to the 10+ different keys in the original music. We show that our Classifying VAE and Classifying VAE+LSTM models outperform the corresponding non-classifying models in generating musical samples that stay in key. This benefit is especially apparent when trained on untransposed music data in the original keys.

📄 PDF Abstract BibTeX arXiv:1711.07050

Code (0)

등록된 구현이 없습니다.

Tasks

Music Generation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
Solana Customer Service Number +1-833-534-1729 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
USD Coin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

PIANOTREE VAE: Structured Representation Learning for Polyphonic Music

2020-08-17 · Ziyu Wang, Yiyi Zhang, Yixiao Zhang, Junyan Jiang 외

The dominant approach for music representation learning involves the deep unsupervised model family variational autoencoder (VAE). However, most, if not all, viable attempts on this problem have largely been limited to m…

Music GenerationRepresentation Learning

Conditional variational autoencoder to improve neural audio synthesis for polyphonic music sound

2022-11-16 · Seokjin Lee, Minhan Kim, Seunghyeon Shin, Daeho Lee 외

Deep generative models for audio synthesis have recently been significantly improved. However, the task of modeling raw-waveforms remains a difficult problem, especially for audio waveforms and music signals. Recently, t…

Audio Synthesis

Calliope -- A Polyphonic Music Transformer

2021-07-08 · Andrea Valenti, Stefano Berti, Davide Bacciu

The polyphonic nature of music makes the application of deep learning to music modelling a challenging task. On the other hand, the Transformer architecture seems to be a good fit for this kind of data. In this work, we …

MIDI-VAE: Modeling Dynamics and Instrumentation of Music with Applications to Style Transfer

2018-09-20 · Gino Brunner, Andres Konrad, Yuyi Wang, Roger Wattenhofer

We introduce MIDI-VAE, a neural network model based on Variational Autoencoders that is capable of handling polyphonic music with multiple instrument tracks, as well as modeling the dynamics of music by incorporating not…

Style Transfer

Modeling Melodic Feature Dependency with Modularized Variational Auto-Encoder

2018-10-31 · Yu-An Wang, Yu-Kai Huang, Tzu-Chuan Lin, Shang-Yu Su 외

Automatic melody generation has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melodies has turned out to be highly challenging. This paper introduces 1) a new…