paper-with-me

Papers

Melody Infilling with User-Provided Structural Context

2022-10-06 · Chih-Pin Tan, Alvin W. Y. Su, Yi-Hsuan Yang

This paper proposes a novel Transformer-based model for music score infilling, to generate a music passage that fills in the gap between given past and future contexts. While existing infilling approaches can generate a passage that connects smoothly locally with the given contexts, they do not take into account the musical form or structure of the music and may therefore generate overly smooth results. To address this issue, we propose a structure-aware conditioning approach that employs a novel attention-selecting module to supply user-provided structure-related information to the Transformer for infilling. With both objective and subjective evaluations, we show that the proposed model can harness the structural information effectively and generate melodies in the style of pop of higher quality than the two existing structure-agnostic infilling models.

📄 PDF Abstract BibTeX arXiv:2210.02829

Code (1)

tanchihpin0517/structure-aware_infilling 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation

2023-09-19 · Xinda Wu, Zhijie Huang, Kejun Zhang, Jiaxing Yu 외

Pre-trained language models have achieved impressive results in various music understanding and generation tasks. However, existing pre-training methods for symbolic melody generation struggle to capture multi-scale, mul…

Rhythm

ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinement

2025-02-06 · Keshav Bhandari, Sungkyun Chang, Tongyu Lu, Fareza R. Enus 외

Despite deep learning's remarkable advances in style transfer across various domains, generating controllable performance-level musical style transfer for complete symbolically represented musical works remains a challen…

Music GenerationRhythmStyle Transfer

SongGLM: Lyric-to-Melody Generation with 2D Alignment Encoding and Multi-Task Pre-Training

2024-12-24 · Jiaxing Yu, Xinda Wu, Yunfei Xu, Tieyao Zhang 외

Lyric-to-melody generation aims to automatically create melodies based on given lyrics, requiring the capture of complex and subtle correlations between them. However, previous works usually suffer from two main challeng…

MR4MR: Mixed Reality for Melody Reincarnation

2022-09-15 · Atsuya Kobayashi, Ryogo Ishino, Ryuku Nobusue, Takumi Inoue 외

There is a long history of an effort made to explore musical elements with the entities and spaces around us, such as musique concr\`ete and ambient music. In the context of computer music and digital art, interactive ex…

Mixed RealityMusic Generation

MusIAC: An extensible generative framework for Music Infilling Applications with multi-level Control

2022-02-11 · Rui Guo, Ivor Simpson, Chris Kiefer, Thor Magnusson 외

We present a novel music generation framework for music infilling, with a user friendly interface. Infilling refers to the task of generating musical sections given the surrounding multi-track music. The proposed transfo…

Music GenerationRhythm