Interpreting Graphic Notation with MusicLDM: An AI Improvisation of Cornelius Cardew's Treatise
This work presents a novel method for composing and improvising music inspired by Cornelius Cardew's Treatise, using AI to bridge graphic notation and musical expression. By leveraging OpenAI's ChatGPT to interpret the abstract visual elements of Treatise, we convert these graphical images into descriptive textual prompts. These prompts are then input into MusicLDM, a pre-trained latent diffusion model designed for music generation. We introduce a technique called "outpainting," which overlaps sections of AI-generated music to create a seamless and cohesive composition. We demostrate a new perspective on performing and interpreting graphic scores, showing how AI can transform visual stimuli into sound and expand the creative possibilities in contemporary/experimental music composition. Musical pieces are available at https://bit.ly/TreatiseAI
Code (0)
등록된 구현이 없습니다.
Tasks
DescriptiveMusic GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies
Diffusion models have shown promising results in cross-modal generation tasks, including text-to-image and text-to-audio generation. However, generating music, as a special type of audio, presents unique challenges due t…
Audio GenerationBeat TrackingData AugmentationMusic Generation+1Music Interpretation and Emotion Perception: A Computational and Neurophysiological Investigation
This study investigates emotional expression and perception in music performance using computational and neurophysiological methods. The influence of different performance settings, such as repertoire, diatonic modal etu…
Emotion RecognitionEmovectors: assessing emotional content in jazz improvisations for creativity evaluation
Music improvisation is fascinating to study, being essentially a live demonstration of a creative process. In jazz, musicians often improvise across predefined chord progressions (leadsheets). How do we assess the creati…
Detecting and Characterizing Planning in Language Models
Modern large language models (LLMs) have demonstrated impressive performance across a wide range of multi-step reasoning tasks. Recent work suggests that LLMs may perform planning - selecting a future target token in adv…
Code GenerationCALLIG: Computer Assisted Language Learning using Improvisation Games
In this paper, we present the ongoing development of CALLIG {--} a web system that uses improvisation games in Computer Assisted Language Learning (CALL). Improvisation games are structured activities with built-in const…