paper-with-me

Papers

Anticipatory Music Transformer

2023-06-14 · John Thickstun, David Hall, Chris Donahue, Percy Liang

We introduce anticipation: a method for constructing a controllable generative model of a temporal point process (the event process) conditioned asynchronously on realizations of a second, correlated process (the control process). We achieve this by interleaving sequences of events and controls, such that controls appear following stopping times in the event sequence. This work is motivated by problems arising in the control of symbolic music generation. We focus on infilling control tasks, whereby the controls are a subset of the events themselves, and conditional generation completes a sequence of events given the fixed control events. We train anticipatory infilling models using the large and diverse Lakh MIDI music dataset. These models match the performance of autoregressive models for prompted music generation, with the additional capability to perform infilling control tasks, including accompaniment. Human evaluators report that an anticipatory model produces accompaniments with similar musicality to even music composed by humans over a 20-second clip.

📄 PDF Abstract BibTeX arXiv:2306.08620

Code (1)

jthickstun/anticipation

Tasks

Music Generation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Moonbeam: A MIDI Foundation Model Using Both Absolute and Relative Music Attributes

2025-05-21 · Zixun Guo, Simon Dixon

Moonbeam is a transformer-based foundation model for symbolic music, pretrained on a large and diverse collection of MIDI data totaling 81.6K hours of music and 18 billion tokens. Moonbeam incorporates music-domain induc…

Music ClassificationMusic Generation

Local deployment of large-scale music AI models on commodity hardware

2024-11-14 · Xun Zhou, Charlie Ruan, Zihe Zhao, Tianqi Chen 외

We present the MIDInfinite, a web application capable of generating symbolic music using a large-scale generative AI model locally on commodity hardware. Creating this demo involved porting the Anticipatory Music Transfo…

Language ModelingLanguage ModellingLarge Language Model

ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinement

2025-02-06 · Keshav Bhandari, Sungkyun Chang, Tongyu Lu, Fareza R. Enus 외

Despite deep learning's remarkable advances in style transfer across various domains, generating controllable performance-level musical style transfer for complete symbolically represented musical works remains a challen…

Music GenerationRhythmStyle Transfer

Anticipation in collaborative music performance using fuzzy systems: a case study

2019-06-05 · Oscar Thörn, Peter Fögel, Peter Knudsen, Luis de Miranda 외

In order to collaborate and co-create with humans, an AI system must be capable of both reactive and anticipatory behavior. We present a case study of such a system in the domain of musical improvisation. We consider a d…

Architectural Proprioception in State Space Models: Thermodynamic Training Induces Anticipatory Halt Detection

2026-03-04 · Jay Noon arxiv

We introduce the Probability Navigation Architecture (PNA) framework, which treats neural computation as navigation through a probability manifold governed by thermodynamic principles. We train State Space Models (SSMs) …