A Study on the Data Distribution Gap in Music Emotion Recognition
Music Emotion Recognition (MER) is a task deeply connected to human perception, relying heavily on subjective annotations collected from contributors. Prior studies tend to focus on specific musical styles rather than incorporating a diverse range of genres, such as rock and classical, within a single framework. In this paper, we address the task of recognizing emotion from audio content by investigating five datasets with dimensional emotion annotations -- EmoMusic, DEAM, PMEmo, WTC, and WCMED -- which span various musical styles. We demonstrate the problem of out-of-distribution generalization in a systematic experiment. By closely looking at multiple data and feature sets, we provide insight into genre-emotion relationships in existing data and examine potential genre dominance and dataset biases in certain feature representations. Based on these experiments, we arrive at a simple yet effective framework that combines embeddings extracted from the Jukebox model with chroma features and demonstrate how, alongside a combination of several diverse training sets, this permits us to train models with substantially improved cross-dataset generalization capabilities.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion RecognitionSimilar Papers 제목 키워드 기반
Transformer-based approach towards music emotion recognition from lyrics
The task of identifying emotions from a given music track has been an active pursuit in the Music Information Retrieval (MIR) community for years. Music emotion recognition has typically relied on acoustic features, soci…
Emotion RecognitionInformation RetrievalMusic Emotion RecognitionMusic Information Retrieval+3A New Multilabel System for Automatic Music Emotion Recognition
Achieving advancements in automatic recognition of emotions that music can induce require considering multiplicity and simultaneity of emotions. Comparison of different machine learning algorithms performing multilabel a…
BIG-bench Machine LearningEmotion RecognitionGeneral ClassificationMusic Emotion RecognitionAddressing Emotion Bias in Music Emotion Recognition and Generation with Frechet Audio Distance
The complex nature of musical emotion introduces inherent bias in both recognition and generation, particularly when relying on a single audio encoder, emotion classifier, or evaluation metric. In this work, we conduct a…
Emotion RecognitionFADMusic Emotion RecognitionMusic GenerationFusion of EEG and Musical Features in Continuous Music-emotion Recognition
Emotion estimation in music listening is confronting challenges to capture the emotion variation of listeners. Recent years have witnessed attempts to exploit multimodality fusing information from musical contents and ph…
EEGElectroencephalogram (EEG)Emotion RecognitionMusic Emotion RecognitionA Comparative Study of Western and Chinese Classical Music based on Soundscape Models
Whether literally or suggestively, the concept of soundscape is alluded in both modern and ancient music. In this study, we examine whether we can analyze and compare Western and Chinese classical music based on soundsca…
Emotion RecognitionEvent DetectionMusic Emotion RecognitionSound Event Detection+1