paper-with-me

Papers

Syllable-level lyrics generation from melody exploiting character-level language model

2023-10-02 · Zhe Zhang, Karol Lasocki, Yi Yu, Atsuhiro Takasu

The generation of lyrics tightly connected to accompanying melodies involves establishing a mapping between musical notes and syllables of lyrics. This process requires a deep understanding of music constraints and semantic patterns at syllable-level, word-level, and sentence-level semantic meanings. However, pre-trained language models specifically designed at the syllable level are publicly unavailable. To solve these challenging issues, we propose to exploit fine-tuning character-level language models for syllable-level lyrics generation from symbolic melody. In particular, our method endeavors to incorporate linguistic knowledge of the language model into the beam search process of a syllable-level Transformer generator network. Additionally, by exploring ChatGPT-based evaluation for generated lyrics, along with human subjective evaluation, we demonstrate that our approach enhances the coherence and correctness of the generated lyrics, eliminating the need to train expensive new language models.

📄 PDF Abstract BibTeX arXiv:2310.00863

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingSentence

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Adam 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

A Syllable-Structured, Contextually-Based Conditionally Generation of Chinese Lyrics

2019-06-15 · Xu Lu, Jie Wang, Bojin Zhuang, Shaojun Wang 외

This paper presents a novel, syllable-structured Chinese lyrics generation model given a piece of original melody. Most previously reported lyrics generation models fail to include the relationship between lyrics and mel…

Conditional LSTM-GAN for Melody Generation from Lyrics

2019-08-15 · Yi Yu, Abhishek Srivastava, Simon Canales

Melody generation from lyrics has been a challenging research issue in the field of artificial intelligence and music, which enables to learn and discover latent relationship between interesting lyrics and accompanying m…

Generative Adversarial Network

A Melody-Conditioned Lyrics Language Model

2018-06-01 · NAACL 2018 6 · Kento Watanabe, Yuichiroh Matsubayashi, Satoru Fukayama, Masataka Goto 외

This paper presents a novel, data-driven language model that produces entire lyrics for a given input melody. Previously proposed models for lyrics generation suffer from the inability of capturing the relationship betwe…

Language ModelingLanguage ModellingmodelSentence

CSL-L2M: Controllable Song-Level Lyric-to-Melody Generation Based on Conditional Transformer with Fine-Grained Lyric and Musical Controls

2024-12-13 · Li Chai, Donglin Wang

Lyric-to-melody generation is a highly challenging task in the field of AI music generation. Due to the difficulty of learning strict yet weak correlations between lyrics and melodies, previous methods have suffered from…

DecoderMusic GenerationSentence

Weird AI Yankovic: Generating Parody Lyrics

2020-09-25 · Mark Riedl

Lyrics parody swaps one set of words that accompany a melody with a new set of words, preserving the number of syllables per line and the rhyme scheme. Lyrics parody generation is a challenge for controllable text genera…

Text Generation