paper-with-me

홈 › Papers

ByteComposer: a Human-like Melody Composition Method based on Language Model Agent

2024-02-24 · Xia Liang, Xingjian Du, Jiaju Lin, Pei Zou, Yuan Wan, Bilei Zhu

Large Language Models (LLM) have shown encouraging progress in multimodal understanding and generation tasks. However, how to design a human-aligned and interpretable melody composition system is still under-explored. To solve this problem, we propose ByteComposer, an agent framework emulating a human's creative pipeline in four separate steps : "Conception Analysis - Draft Composition - Self-Evaluation and Modification - Aesthetic Selection". This framework seamlessly blends the interactive and knowledge-understanding features of LLMs with existing symbolic music generation models, thereby achieving a melody composition agent comparable to human creators. We conduct extensive experiments on GPT4 and several open-source large language models, which substantiate our framework's effectiveness. Furthermore, professional music composers were engaged in multi-dimensional evaluations, the final results demonstrated that across various facets of music composition, ByteComposer agent attains the level of a novice melody composer.

📄 PDF Abstract BibTeX arXiv:2402.17785

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingMusic Generation

Similar Papers 제목 키워드 기반

Neural Melody Composition from Lyrics

2018-09-12 · Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui 외

In this paper, we study a novel task that learns to compose music from natural language. Given the lyrics as input, we propose a melody composition model that generates lyrics-conditional melody as well as the exact alig…

Decoder

Agent-Driven Large Language Models for Mandarin Lyric Generation

2024-10-02 · Hong-Hsiang Liu, Yi-Wen Liu

Generative Large Language Models have shown impressive in-context learning abilities, performing well across various tasks with just a prompt. Previous melody-to-lyric research has been limited by scarce high-quality ali…

In-Context LearningLanguage ModelingLanguage Modelling

Exploring Inherent Properties of the Monophonic Melody of Songs

2020-03-20 · Zehao Wang, Shicheng Zhang, Xiaoou Chen

Melody is one of the most important components in music. Unlike other components in music theory, such as harmony and counterpoint, computable features for melody is urgently in need. These features are highly demanded a…

Information RetrievalRetrievalSentence

SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition

2024-02-27 · Shuangrui Ding, Zihan Liu, Xiaoyi Dong, Pan Zhang 외

Creating lyrics and melodies for the vocal track in a symbolic format, known as song composition, demands expert musical knowledge of melody, an advanced understanding of lyrics, and precise alignment between them. Despi…

Instruction FollowingLanguage ModelingLanguage ModellingLarge Language Model+1

Automatic Neural Lyrics and Melody Composition

2020-11-12 · Gurunath Reddy Madhumani, Yi Yu, Florian Harscoët, Simon Canales 외

In this paper, we propose a technique to address the most challenging aspect of algorithmic songwriting process, which enables the human community to discover original lyrics, and melodies suitable for the generated lyri…

DecoderSentence