paper-with-me

홈 › Papers

Multi-Genre Music Transformer -- Composing Full Length Musical Piece

2023-01-06 · Abhinav Kaushal Keshari

In the task of generating music, the art factor plays a big role and is a great challenge for AI. Previous work involving adversarial training to produce new music pieces and modeling the compatibility of variety in music (beats, tempo, musical stems) demonstrated great examples of learning this task. Though this was limited to generating mashups or learning features from tempo and key distributions to produce similar patterns. Compound Word Transformer was able to represent music generation task as a sequence generation challenge involving musical events defined by compound words. These musical events give a more accurate description of notes progression, chord change, harmony and the art factor. The objective of the project is to implement a Multi-Genre Transformer which learns to produce music pieces through more adaptive learning process involving more challenging task where genres or form of the composition is also considered. We built a multi-genre compound word dataset, implemented a linear transformer which was trained on this dataset. We call this Multi-Genre Transformer, which was able to generate full length new musical pieces which is diverse and comparable to original tracks. The model trains 2-5 times faster than other models discussed.

📄 PDF Abstract BibTeX arXiv:2301.02385

Code (0)

등록된 구현이 없습니다.

Tasks

Music Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinement

2025-02-06 · Keshav Bhandari, Sungkyun Chang, Tongyu Lu, Fareza R. Enus 외

Despite deep learning's remarkable advances in style transfer across various domains, generating controllable performance-level musical style transfer for complete symbolically represented musical works remains a challen…

Music GenerationRhythmStyle Transfer

Equipping Pretrained Unconditional Music Transformers with Instrument and Genre Controls

2023-11-21 · Weihan Xu, Julian McAuley, Shlomo Dubnov, Hao-Wen Dong

The ''pretraining-and-finetuning'' paradigm has become a norm for training domain-specific models in natural language processing and computer vision. In this work, we aim to examine this paradigm for symbolic music gener…

Music Generation

FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generation

2022-12-07 · ICCV 2023 1 · Ronghui Li, Junfan Zhao, Yachao Zhang, Mingyang Su 외

Generating full-body and multi-genre dance sequences from given music is a challenging task, due to the limitations of existing datasets and the inherent complexity of the fine-grained hand motion and dance genres. To ad…

Motion SynthesisRetrieval

Can MusicGen Create Training Data for MIR Tasks?

2023-11-15 · Nadine Kroher, Helena Cuesta, Aggelos Pikrakis

We are investigating the broader concept of using AI-based generative music systems to generate training data for Music Information Retrieval (MIR) tasks. To kick off this line of work, we ran an initial experiment in wh…

Information RetrievalMusic Information RetrievalRetrieval

GCDance: Genre-Controlled 3D Full Body Dance Generation Driven By Music

2025-02-25 · Xinran Liu, Xu Dong, Diptesh Kanojia, Wenwu Wang 외

Generating high-quality full-body dance sequences from music is a challenging task as it requires strict adherence to genre-specific choreography. Moreover, the generated sequences must be both physically realistic and p…

Rhythm