Generating music with sentiment using Transformer-GANs
The field of Automatic Music Generation has seen significant progress thanks to the advent of Deep Learning. However, most of these results have been produced by unconditional models, which lack the ability to interact with their users, not allowing them to guide the generative process in meaningful and practical ways. Moreover, synthesizing music that remains coherent across longer timescales while still capturing the local aspects that make it sound `realistic'' or `human-like'' is still challenging. This is due to the large computational requirements needed to work with long sequences of data, and also to limitations imposed by the training schemes that are often employed. In this paper, we propose a generative model of symbolic music conditioned by data retrieved from human sentiment. The model is a Transformer-GAN trained with labels that correspond to different configurations of the valence and arousal dimensions that quantitatively represent human affective states. We try to tackle both of the problems above by employing an efficient linear version of Attention and using a Discriminator both as a tool to improve the overall quality of the generated music and its ability to follow the conditioning signals.
Code (1)
Tasks
Music GenerationSimilar Papers 제목 키워드 기반
Unrolled Creative Adversarial Network For Generating Novel Musical Pieces
Music generation has been established as a prominent topic in artificial intelligence and machine learning over recent years. In most recent works on RNN-based neural network methods have been applied for sequence genera…
Music GenerationStory2MIDI: Emotionally Aligned Music Generation from Text
In this paper, we introduce Story2MIDI, a sequence-to-sequence Transformer-based model for generating emotion-aligned music from a given piece of text. To develop this model, we construct the Story2MIDI dataset by mergin…
Emotion ClassificationSentiment AnalysisMusic Generationdeepsing: Generating Sentiment-aware Visual Stories using Cross-modal Music Translation
In this paper we propose a deep learning method for performing attributed-based music-to-image translation. The proposed method is applied for synthesizing visual stories according to the sentiment expressed by songs. Th…
Deep LearningTranslationA Survey of Music Generation in the Context of Interaction
In recent years, machine learning, and in particular generative adversarial neural networks (GANs) and attention-based neural networks (transformers), have been successfully used to compose and generate music, both melod…
Music GenerationStyle TransferSurveyA Novel Bi-LSTM And Transformer Architecture For Generating Tabla Music
Introduction: Music generation is a complex task that has received significant attention in recent years, and deep learning techniques have shown promising results in this field. Objectives: While extensive work has been…
Music Generation