paper-with-me

홈 › Papers

Expressive Music Data Processing and Generation

2025-03-14 · Jingwei Liu

Musical expressivity and coherence are indispensable in music composition and performance, while often neglected in modern AI generative models. In this work, we introduce a listening-based data-processing technique that captures the expressivity in musical performance. This technique derived from Weber's law reflects the human perceptual truth of listening and preserves musical subtlety and expressivity in the training input. To facilitate musical coherence, we model the output interdependencies among multiple arguments in the music data such as pitch, duration, velocity, etc. in the neural networks based on the probabilistic chain rule. In practice, we decompose the multi-output sequential model into single-output submodels and condition previously sampled outputs on the subsequent submodels to induce conditional distributions. Finally, to select eligible sequences from all generations, a tentative measure based on the output entropy was proposed. The entropy sequence is set as a criterion to select predictable and stable generations, which is further studied under the context of informational aesthetic measures to quantify musical pleasure and information gain along the music tendency.

📄 PDF Abstract BibTeX arXiv:2503.11896

Code (1)

Jovie-Liu/Expressive-Piano-MIDI-Generation 공식 구현

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Expressive MIDI-format Piano Performance Generation

2024-08-01 · Jingwei Liu

This work presents a generative neural network that's able to generate expressive piano performance in MIDI format. The musical expressivity is reflected by vivid micro-timing, rich polyphonic texture, varied dynamics, a…

Music Generation

PerceiverS: A Multi-Scale Perceiver with Effective Segmentation for Long-Term Expressive Symbolic Music Generation

2024-11-13 · Yungang Yi, Weihua Li, Matthew Kuo, Quan Bai

AI-based music generation has progressed significantly in recent years. However, creating symbolic music that is both long-structured and expressive remains a considerable challenge. In this paper, we propose PerceiverS …

Audio GenerationDiversityMusic GenerationSegmentation

MOSA: Music Motion with Semantic Annotation Dataset for Cross-Modal Music Processing

2024-06-10 · Yu-Fen Huang, Nikki Moran, Simon Coleman, Jon Kelly 외

In cross-modal music processing, translation between visual, auditory, and semantic content opens up new possibilities as well as challenges. The construction of such a transformative scheme depends upon a benchmark corp…

Information RetrievalMusic Information Retrieval

EXPOTION: Facial Expression and Motion Control for Multimodal Music Generation

2025-07-07 · Fathinah Izzati, Xinyue Li, Gus Xia arxiv

We propose Expotion (Facial Expression and Motion Control for Multimodal Music Generation), a generative model leveraging multimodal visual controls - specifically, human facial expressions and upper-body motion - as wel…

parameter-efficient fine-tuningText-to-Music Generation

Exploring Classical Piano Performance Generation with Expressive Music Variational AutoEncoder

2025-07-02 · Jing Luo, Xinyu Yang, Jie Wei arxiv

The creativity of classical music arises not only from composers who craft the musical sheets but also from performers who interpret the static notations with expressive nuances. This paper addresses the challenge of gen…