paper-with-me

Papers

Controlling Surprisal in Music Generation via Information Content Curve Matching

2024-08-12 · Mathias Rose Bjare, Stefan Lattner, Gerhard Widmer

In recent years, the quality and public interest in music generation systems have grown, encouraging research into various ways to control these systems. We propose a novel method for controlling surprisal in music generation using sequence models. To achieve this goal, we define a metric called Instantaneous Information Content (IIC). The IIC serves as a proxy function for the perceived musical surprisal (as estimated from a probabilistic model) and can be calculated at any point within a music piece. This enables the comparison of surprisal across different musical content even if the musical events occur in irregular time intervals. We use beam search to generate musical material whose IIC curve closely approximates a given target IIC. We experimentally show that the IIC correlates with harmonic and rhythmic complexity and note density. The correlation decreases with the length of the musical context used for estimating the IIC. Finally, we conduct a qualitative user study to test if human listeners can identify the IIC curves that have been used as targets when generating the respective musical material. We provide code for creating IIC interpolations and IIC visualizations on https://github.com/muthissar/iic.

📄 PDF Abstract BibTeX arXiv:2408.06022

Code (1)

muthissar/iic 공식 구현 pytorch

Tasks

Music Generation

Similar Papers 제목 키워드 기반

Estimating Musical Surprisal from Audio in Autoregressive Diffusion Model Noise Spaces

2025-08-07 · Mathias Rose Bjare, Stefan Lattner, Gerhard Widmer arxiv

Recently, the information content (IC) of predictions from a Generative Infinite-Vocabulary Transformer (GIVT) has been used to model musical expectancy and surprisal in audio. We investigate the effectiveness of such mo…

Estimating Musical Surprisal in Audio

2025-01-13 · Mathias Rose Bjare, Giorgia Cantisani, Stefan Lattner, Gerhard Widmer

In modeling musical surprisal expectancy with computational methods, it has been proposed to use the information content (IC) of one-step predictions from an autoregressive model as a proxy for surprisal in symbolic musi…

EEG

On the Role of Context in Reading Time Prediction

2024-09-12 · Andreas Opedal, Eleanor Chodroff, Ryan Cotterell, Ethan Gotlieb Wilcox

We present a new perspective on how readers integrate context during real-time language comprehension. Our proposals build on surprisal theory, which posits that the processing effort of a linguistic unit (e.g., a word) …

Language ModelingLanguage ModellingPrediction

Expect the Unexpected? Testing the Surprisal of Salient Entities

2026-04-12 · Jessica Lin, Amir Zeldes arxiv

Previous work examining the Uniform Information Density (UID) hypothesis has shown that while information as measured by surprisal metrics is distributed more or less evenly across documents overall, local discrepancies …

Diff-TONE: Timestep Optimization for iNstrument Editing in Text-to-Music Diffusion Models

2025-06-18 · Teysir Baoueb, Xiaoyu Bie, Xi Wang, Gaël Richard

Breakthroughs in text-to-music generation models are transforming the creative landscape, equipping musicians with innovative tools for composition and experimentation like never before. However, controlling the generati…

Music GenerationText-to-Music Generation