paper-with-me

홈 › Papers

Encoding Musical Style with Transformer Autoencoders

2019-12-10 · ICML 2020 1 · Kristy Choi, Curtis Hawthorne, Ian Simon, Monica Dinculescu, Jesse Engel

We consider the problem of learning high-level controls over the global structure of generated sequences, particularly in the context of symbolic music generation with complex language models. In this work, we present the Transformer autoencoder, which aggregates encodings of the input data across time to obtain a global representation of style from a given performance. We show it is possible to combine this global representation with other temporally distributed embeddings, enabling improved control over the separate aspects of performance style and melody. Empirically, we demonstrate the effectiveness of our method on various music generation tasks on the MAESTRO dataset and a YouTube dataset with 10,000+ hours of piano performances, where we achieve improvements in terms of log-likelihood and mean listening scores as compared to baselines.

📄 PDF Abstract BibTeX arXiv:1912.05537

Code (0)

등록된 구현이 없습니다.

Tasks

Music Generation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Learning and Evaluating Musical Features with Deep Autoencoders

2017-06-14 · Mason Bretan, Sageev Oore, Doug Eck, Larry Heck

In this work we describe and evaluate methods to learn musical embeddings. Each embedding is a vector that represents four contiguous beats of music and is derived from a symbolic representation. We consider autoencoding…

DenoisingGeneral Classification

MuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAE

2021-05-10 · Shih-Lun Wu, Yi-Hsuan Yang

Transformers and variational autoencoders (VAE) have been extensively employed for symbolic (e.g., MIDI) domain music generation. While the former boast an impressive capability in modeling long sequences, the latter all…

DecoderMusic GenerationMusic Style TransferStyle Transfer

Learning Style-Aware Symbolic Music Representations by Adversarial Autoencoders

2020-01-15 · Andrea Valenti, Antonio Carta, Davide Bacciu

We address the challenging open problem of learning an effective latent space for symbolic music data in generative music modeling. We focus on leveraging adversarial regularization as a flexible and natural mean to imbu…

Music Modeling

ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinement

2025-02-06 · Keshav Bhandari, Sungkyun Chang, Tongyu Lu, Fareza R. Enus 외

Despite deep learning's remarkable advances in style transfer across various domains, generating controllable performance-level musical style transfer for complete symbolically represented musical works remains a challen…

Music GenerationRhythmStyle Transfer

Discovering "Words" in Music: Unsupervised Learning of Compositional Sparse Code for Symbolic Music

2025-09-29 · Tianle Wang, Sirui Zhang, Xinyi Tong, Peiyang Yu 외 arxiv

This paper presents an unsupervised machine learning algorithm that identifies recurring patterns -- referred to as ``music-words'' -- from symbolic music data. These patterns are fundamental to musical structure and ref…

Music GenerationStyle Transfer