paper-with-me

홈 › Papers

Perception-Inspired Graph Convolution for Music Understanding Tasks

2024-05-15 · Emmanouil Karystinaios, Francesco Foscarin, Gerhard Widmer

We propose a new graph convolutional block, called MusGConv, specifically designed for the efficient processing of musical score data and motivated by general perceptual principles. It focuses on two fundamental dimensions of music, pitch and rhythm, and considers both relative and absolute representations of these components. We evaluate our approach on four different musical understanding problems: monophonic voice separation, harmonic analysis, cadence detection, and composer identification which, in abstract terms, translate to different graph learning problems, namely, node classification, link prediction, and graph classification. Our experiments demonstrate that MusGConv improves the performance on three of the aforementioned tasks while being conceptually very simple and efficient. We interpret this as evidence that it is beneficial to include perception-informed processing of fundamental musical concepts when developing graph network applications on musical score data.

📄 PDF Abstract BibTeX arXiv:2405.09224

Code (1)

manoskary/musgconv 공식 구현 pytorch

Tasks

Graph ClassificationGraph LearningLink PredictionNode ClassificationRhythm

Similar Papers 제목 키워드 기반

The artificial synesthete: Image-melody translations with variational autoencoders

2021-12-06 · Karl Wienand, Wolfgang M. Heckl

Abstract This project presents a system of neural networks to translate between images and melodies. Autoencoders compress the information in samples to abstract representation. A translation network learns a set of corr…

Translation

Relating Human Perception of Musicality to Prediction in a Predictive Coding Model

2022-10-29 · Nikolas McNeal, Jennifer Huang, Aniekan Umoren, Shuqi Dai 외

We explore the use of a neural network inspired by predictive coding for modeling human music perception. This network was developed based on the computational neuroscience theory of recurrent interactions in the hierarc…

Self-Supervised Learning

Mode-conditioned music learning and composition: a spiking neural network inspired by neuroscience and psychology

2024-11-22 · Qian Liang, Yi Zeng, Menghaoran Tang

Musical mode is one of the most critical element that establishes the framework of pitch organization and determines the harmonic relationships. Previous works often use the simplistic and rigid alignment method, and ove…

Representing Classical Compositions through Implication-Realization Temporal-Gestalt Graphs

2025-10-31 · A. V. Bomediano, R. J. Conanan, L. D. Santuyo, A. Coronel arxiv

Understanding the structural and cognitive underpinnings of musical compositions remains a key challenge in music theory and computational musicology. While traditional methods focus on harmony and rhythm, cognitive mode…

The MUSE Benchmark: Probing Music Perception and Auditory Relational Reasoning in Audio LLMS

2025-10-21 · Brandon James Carone, Iran R. Roman, Pablo Ripollés arxiv

Multimodal Large Language Models (MLLMs) have demonstrated capabilities in audio understanding, but current evaluations may obscure fundamental weaknesses in relational reasoning. We introduce the Music Understanding and…

Relational Reasoning