ByteComposer: a Human-like Melody Composition Method based on Language Model Agent
Large Language Models (LLM) have shown encouraging progress in multimodal understanding and generation tasks. However, how to design a human-aligned and interpretable melody composition system is still under-explored. To solve this problem, we propose ByteComposer, an agent framework emulating a human's creative pipeline in four separate steps : "Conception Analysis - Draft Composition - Self-Evaluation and Modification - Aesthetic Selection". This framework seamlessly blends the interactive and knowledge-understanding features of LLMs with existing symbolic music generation models, thereby achieving a melody composition agent comparable to human creators. We conduct extensive experiments on GPT4 and several open-source large language models, which substantiate our framework's effectiveness. Furthermore, professional music composers were engaged in multi-dimensional evaluations, the final results demonstrated that across various facets of music composition, ByteComposer agent attains the level of a novice melody composer.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingMusic GenerationSimilar Papers 제목 키워드 기반
Neural Melody Composition from Lyrics
In this paper, we study a novel task that learns to compose music from natural language. Given the lyrics as input, we propose a melody composition model that generates lyrics-conditional melody as well as the exact alig…
DecoderAgent-Driven Large Language Models for Mandarin Lyric Generation
Generative Large Language Models have shown impressive in-context learning abilities, performing well across various tasks with just a prompt. Previous melody-to-lyric research has been limited by scarce high-quality ali…
In-Context LearningLanguage ModelingLanguage ModellingExploring Inherent Properties of the Monophonic Melody of Songs
Melody is one of the most important components in music. Unlike other components in music theory, such as harmony and counterpoint, computable features for melody is urgently in need. These features are highly demanded a…
Information RetrievalRetrievalSentenceSongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition
Creating lyrics and melodies for the vocal track in a symbolic format, known as song composition, demands expert musical knowledge of melody, an advanced understanding of lyrics, and precise alignment between them. Despi…
Instruction FollowingLanguage ModelingLanguage ModellingLarge Language Model+1Automatic Neural Lyrics and Melody Composition
In this paper, we propose a technique to address the most challenging aspect of algorithmic songwriting process, which enables the human community to discover original lyrics, and melodies suitable for the generated lyri…
DecoderSentence