paper-with-me

Papers

Music auto-tagging in the long tail: A few-shot approach

2024-09-12 · T. Aleksandra Ma, Alexander Lerch

In the realm of digital music, using tags to efficiently organize and retrieve music from extensive databases is crucial for music catalog owners. Human tagging by experts is labor-intensive but mostly accurate, whereas automatic tagging through supervised learning has approached satisfying accuracy but is restricted to a predefined set of training tags. Few-shot learning offers a viable solution to expand beyond this small set of predefined tags by enabling models to learn from only a few human-provided examples to understand tag meanings and subsequently apply these tags autonomously. We propose to integrate few-shot learning methodology into multi-label music auto-tagging by using features from pre-trained models as inputs to a lightweight linear classifier, also known as a linear probe. We investigate different popular pre-trained features, as well as different few-shot parametrizations with varying numbers of classes and samples per class. Our experiments demonstrate that a simple model with pre-trained features can achieve performance close to state-of-the-art models while using significantly less training data, such as 20 samples per tag. Additionally, our linear probe performs competitively with leading models when trained on the entire training dataset. The results show that this transfer learning-based few-shot approach could effectively address the issue of automatically assigning long-tail tags with only limited labeled data.

📄 PDF Abstract BibTeX arXiv:2409.07730

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningMusic Auto-TaggingTAGTransfer Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Joint Music and Language Attention Models for Zero-shot Music Tagging

2023-10-16 · Xingjian Du, Zhesong Yu, Jiaju Lin, Bilei Zhu 외

Music tagging is a task to predict the tags of music recordings. However, previous music tagging research primarily focuses on close-set music tagging tasks which can not be generalized to new tags. In this work, we prop…

Audio TaggingDecoderMusic Tagging

Zero-shot Learning and Knowledge Transfer in Music Classification and Tagging

2019-06-20 · Jeong Choi, Jongpil Lee, Jiyoung Park, Juhan Nam

Music classification and tagging is conducted through categorical supervised learning with a fixed set of labels. In principle, this cannot make predictions on unseen labels. Zero-shot learning is an approach to solve th…

ClassificationGeneral ClassificationMusic ClassificationTransfer Learning+1

Zero-shot Learning for Audio-based Music Classification and Tagging

2019-07-05 · Jeong Choi, Jongpil Lee, Jiyoung Park, Juhan Nam

Audio-based music classification and tagging is typically based on categorical supervised learning with a fixed set of labels. This intrinsically cannot handle unseen labels such as newly added music genres or semantic w…

AttributeClassificationGeneral ClassificationMulti-label zero-shot learning+4

LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Tagging

2024-09-17 · Charilaos Papaioannou, Emmanouil Benetos, Alexandros Potamianos

We introduce Label-Combination Prototypical Networks (LC-Protonets) to address the problem of multi-label few-shot classification, where a model must generalize to new classes based on only a few available examples. Exte…

Audio TaggingFew-Shot LearningMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

MuLan: A Joint Embedding of Music Audio and Natural Language

2022-08-26 · Qingqing Huang, Aren Jansen, Joonseok Lee, Ravi Ganti 외

Music tagging and content-based retrieval systems have traditionally been constructed using pre-defined ontologies covering a rigid set of music attributes or text queries. This paper presents MuLan: a first attempt at a…

Cross-Modal RetrievalMusic TaggingRetrievalTransfer Learning