paper-with-me

홈 › Papers

Calliope -- A Polyphonic Music Transformer

2021-07-08 · Andrea Valenti, Stefano Berti, Davide Bacciu

The polyphonic nature of music makes the application of deep learning to music modelling a challenging task. On the other hand, the Transformer architecture seems to be a good fit for this kind of data. In this work, we present Calliope, a novel autoencoder model based on Transformers for the efficient modelling of multi-track sequences of polyphonic music. The experiments show that our model is able to improve the state of the art on musical sequence reconstruction and generation, with remarkably good results especially on long sequences.

📄 PDF Abstract BibTeX arXiv:2107.05546

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Choir Transformer: Generating Polyphonic Music with Relative Attention on Transformer

2023-08-01 · Jiuyang Zhou, Hong Zhu, Xingping Wang

Polyphonic music generation is still a challenge direction due to its correct between generating melody and harmony. Most of the previous studies used RNN-based models. However, the RNN-based models are hard to establish…

Music GenerationRhythm

CoCoFormer: A controllable feature-rich polyphonic music generation method

2023-10-15 · Jiuyang Zhou, Tengfei Niu, Hong Zhu, Xingping Wang

This paper explores the modeling method of polyphonic music sequence. Due to the great potential of Transformer models in music generation, controllable music generation is receiving more attention. In the task of polyph…

DiversityMusic GenerationRhythm

Calliope: An Online Generative Music System for Symbolic Multi-Track Composition

2025-04-18 · Renaud Bougueng Tchemeube, Jeff Ens, Philippe Pasquier

With the rise of artificial intelligence in recent years, there has been a rapid increase in its application towards creative domains, including music. There exist many systems built that apply machine learning approache…

TrOMR:Transformer-Based Polyphonic Optical Music Recognition

2023-08-18 · Yixuan Li, Huaping Liu, Qiang Jin, Miaomiao Cai 외

Optical Music Recognition (OMR) is an important technology in music and has been researched for a long time. Previous approaches for OMR are usually based on CNN for image understanding and RNN for music symbol classific…

Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription

2012-06-27 · Nicolas Boulanger-Lewandowski, Yoshua Bengio, Pascal Vincent

We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurr…

Language ModelingLanguage ModellingMusic GenerationMusic Modeling