paper-with-me

홈 › Papers

Deep Generative Models of Music Expectation

2023-10-05 · Ninon Lizé Masclef, T. Anderson Keller

A prominent theory of affective response to music revolves around the concepts of surprisal and expectation. In prior work, this idea has been operationalized in the form of probabilistic models of music which allow for precise computation of song (or note-by-note) probabilities, conditioned on a 'training set' of prior musical or cultural experiences. To date, however, these models have been limited to compute exact probabilities through hand-crafted features or restricted to linear models which are likely not sufficient to represent the complex conditional distributions present in music. In this work, we propose to use modern deep probabilistic generative models in the form of a Diffusion Model to compute an approximate likelihood of a musical input sequence. Unlike prior work, such a generative model parameterized by deep neural networks is able to learn complex non-linear features directly from a training set itself. In doing so, we expect to find that such models are able to more accurately represent the 'surprisal' of music for human listeners. From the literature, it is known that there is an inverted U-shaped relationship between surprisal and the amount human subjects 'like' a given song. In this work we show that pre-trained diffusion models indeed yield musical surprisal values which exhibit a negative quadratic relationship with measured subject 'liking' ratings, and that the quality of this relationship is competitive with state of the art methods such as IDyOM. We therefore present this model a preliminary step in developing modern deep generative models of music expectation and subjective likability.

📄 PDF Abstract BibTeX arXiv:2310.03500

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

From Bach to the Beatles: The simulation of human tonal expectation using ecologically-trained predictive models

2017-07-19 · Carlos Cancino-Chacón, Maarten Grachten, Kat Agres

Tonal structure is in part conveyed by statistical regularities between musical events, and research has shown that computational models reflect tonal structure in music by capturing these regularities in schematic const…

MuDiT & MuSiT: Alignment with Colloquial Expression in Description-to-Song Generation

2024-07-03 · ZiHao Wang, Haoxuan Liu, Jiaxing Yu, Tao Zhang 외

Amid the rising intersection of generative AI and human artistic processes, this study probes the critical yet less-explored terrain of alignment in human-centric automatic song composition. We propose a novel task of Co…

DescriptiveRhythm

Exploratory Study Of Human-AI Interaction For Hindustani Music

2024-11-21 · Nithya Shikarpur, Cheng-Zhi Anna Huang

This paper presents a study of participants interacting with and using GaMaDHaNi, a novel hierarchical generative model for Hindustani vocal contours. To explore possible use cases in human-AI interaction, we conducted a…

Expectation and Acoustic Neural Network Representations Enhance Music Identification from Brain Activity

2026-03-03 · Shogo Noguchi, Taketo Akama, Tai Nakamura, Shun Minamikawa 외 arxiv

During music listening, cortical activity encodes both acoustic and expectation-related information. Prior work has shown that ANN representations resemble cortical representations and can serve as supervisory signals fo…

Representation Learning

Quantum Memory of Musical Compositions

2023-10-09 · Maria Mannone, Omar Costa Hamido

The perception and appreciation of beauty in a musical composition appears as being related to the amount of memory and balance between expectation and surprise. In this study, we use a formal computing tool derived from…