paper-with-me

홈 › Papers

Perceptual Musical Features for Interpretable Audio Tagging

2023-12-18 · Vassilis Lyberatos, Spyridon Kantarelis, Edmund Dervakos, Giorgos Stamou

In the age of music streaming platforms, the task of automatically tagging music audio has garnered significant attention, driving researchers to devise methods aimed at enhancing performance metrics on standard datasets. Most recent approaches rely on deep neural networks, which, despite their impressive performance, possess opacity, making it challenging to elucidate their output for a given input. While the issue of interpretability has been emphasized in other fields like medicine, it has not received attention in music-related tasks. In this study, we explored the relevance of interpretability in the context of automatic music tagging. We constructed a workflow that incorporates three different information extraction techniques: a) leveraging symbolic knowledge, b) utilizing auxiliary deep neural networks, and c) employing signal processing to extract perceptual features from audio files. These features were subsequently used to train an interpretable machine-learning model for tag prediction. We conducted experiments on two datasets, namely the MTG-Jamendo dataset and the GTZAN dataset. Our method surpassed the performance of baseline models in both tasks and, in certain instances, demonstrated competitiveness with the current state-of-the-art. We conclude that there are use cases where the deterioration in performance is outweighed by the value of interpretability.

📄 PDF Abstract BibTeX arXiv:2312.11234

Code (1)

vaslyb/perceptible-music-tagging 공식 구현

Tasks

Audio TaggingInterpretable Machine LearningMusic TaggingTAG

Similar Papers 제목 키워드 기반

A Modulation Front-End for Music Audio Tagging

2021-05-25 · Cyrus Vahidi, Charalampos Saitis, György Fazekas

Convolutional Neural Networks have been extensively explored in the task of automatic music tagging. The problem can be approached by using either engineered time-frequency features or raw audio as input. Modulation filt…

Audio TaggingMusic TaggingRepresentation Learning

Expressivity-aware Music Performance Retrieval using Mid-level Perceptual Features and Emotion Word Embeddings

2024-01-26 · Shreyan Chowdhury, Gerhard Widmer

This paper explores a specific sub-task of cross-modal music retrieval. We consider the delicate task of retrieving a performance or rendition of a musical piece based on a description of its style, expressive character,…

RetrievalWord Embeddings

Two-level Explanations in Music Emotion Recognition

2019-05-28 · Verena Haunschmid, Shreyan Chowdhury, Gerhard Widmer

Current ML models for music emotion recognition, while generally working quite well, do not give meaningful or intuitive explanations for their predictions. In this work, we propose a 2-step procedure to arrive at spectr…

Emotion RecognitionMusic Emotion RecognitionPredictionVocal Bursts Valence Prediction

Tracing Back Music Emotion Predictions to Sound Sources and Intuitive Perceptual Qualities

2021-06-14 · Shreyan Chowdhury, Verena Praher, Gerhard Widmer

Music emotion recognition is an important task in MIR (Music Information Retrieval) research. Owing to factors like the subjective nature of the task and the variation of emotional cues between musical genres, there are …

Emotion RecognitionInformation RetrievalMusic Emotion RecognitionMusic Information Retrieval+2

audioLIME: Listenable Explanations Using Source Separation

2020-08-02 · Verena Haunschmid, Ethan Manilow, Gerhard Widmer

Deep neural networks (DNNs) are successfully applied in a wide variety of music information retrieval (MIR) tasks but their predictions are usually not interpretable. We propose audioLIME, a method based on Local Interpr…

Information RetrievalMusic Information RetrievalMusic TaggingRetrieval