paper-with-me

홈 › Papers

Estimating Musical Surprisal in Audio

2025-01-13 · Mathias Rose Bjare, Giorgia Cantisani, Stefan Lattner, Gerhard Widmer

In modeling musical surprisal expectancy with computational methods, it has been proposed to use the information content (IC) of one-step predictions from an autoregressive model as a proxy for surprisal in symbolic music. With an appropriately chosen model, the IC of musical events has been shown to correlate with human perception of surprise and complexity aspects, including tonal and rhythmic complexity. This work investigates whether an analogous methodology can be applied to music audio. We train an autoregressive Transformer model to predict compressed latent audio representations of a pretrained autoencoder network. We verify learning effects by estimating the decrease in IC with repetitions. We investigate the mean IC of musical segment types (e.g., A or B) and find that segment types appearing later in a piece have a higher IC than earlier ones on average. We investigate the IC's relation to audio and musical features and find it correlated with timbral variations and loudness and, to a lesser extent, dissonance, rhythmic complexity, and onset density related to audio and musical features. Finally, we investigate if the IC can predict EEG responses to songs and thus model humans' surprisal in music. We provide code for our method on github.com/sonycslparis/audioic.

📄 PDF Abstract BibTeX arXiv:2501.07474

Code (1)

sonycslparis/audioic 공식 구현 pytorch

Tasks

EEG

Methods 이 논문이 사용한 방법론

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Adam 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음

Similar Papers 제목 키워드 기반

Estimating Musical Surprisal from Audio in Autoregressive Diffusion Model Noise Spaces

2025-08-07 · Mathias Rose Bjare, Stefan Lattner, Gerhard Widmer arxiv

Recently, the information content (IC) of predictions from a Generative Infinite-Vocabulary Transformer (GIVT) has been used to model musical expectancy and surprisal in audio. We investigate the effectiveness of such mo…

Controlling Surprisal in Music Generation via Information Content Curve Matching

2024-08-12 · Mathias Rose Bjare, Stefan Lattner, Gerhard Widmer

In recent years, the quality and public interest in music generation systems have grown, encouraging research into various ways to control these systems. We propose a novel method for controlling surprisal in music gener…

Music Generation

Deep Generative Models of Music Expectation

2023-10-05 · Ninon Lizé Masclef, T. Anderson Keller

A prominent theory of affective response to music revolves around the concepts of surprisal and expectation. In prior work, this idea has been operationalized in the form of probabilistic models of music which allow for …

Deep Music Information Dynamics

2021-02-01 · Shlomo Dubnov

Music comprises of a set of complex simultaneous events organized in time. In this paper we introduce a novel framework that we call Deep Musical Information Dynamics, which combines two parallel streams - a low rate lat…

Perceptually Aligning Representations of Music via Noise-Augmented Autoencoders

2025-11-07 · Mathias Rose Bjare, Giorgia Cantisani, Marco Pasini, Stefan Lattner 외 arxiv

We argue that training autoencoders to reconstruct inputs from noised versions of their encodings, when combined with perceptually motivated losses, yields encodings that are structured according to a perceptual hierarch…