Towards Proper Contrastive Self-supervised Learning Strategies For Music Audio Representation
The common research goal of self-supervised learning is to extract a general representation which an arbitrary downstream task would benefit from. In this work, we investigate music audio representation learned from different contrastive self-supervised learning schemes and empirically evaluate the embedded vectors on various music information retrieval (MIR) tasks where different levels of the music perception are concerned. We analyze the results to discuss the proper direction of contrastive learning strategies for different MIR tasks. We show that these representations convey a comprehensive information about the auditory characteristics of music in general, although each of the self-supervision strategies has its own effectiveness in certain aspect of information.
Code (1)
Tasks
Contrastive LearningInformation RetrievalMusic Information RetrievalRetrievalSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semi-Supervised Contrastive Learning of Musical Representations
Despite the success of contrastive learning in Music Information Retrieval, the inherent ambiguity of contrastive self-supervision presents a challenge. Relying solely on augmentation chains and self-supervised positive …
Contrastive LearningInformation RetrievalMusic Information RetrievalTransfer LearningOn the Effect of Data-Augmentation on Local Embedding Properties in the Contrastive Learning of Music Audio Representations
Audio embeddings are crucial tools in understanding large catalogs of music. Typically embeddings are evaluated on the basis of the performance they provide in a wide range of downstream tasks, however few studies have i…
Contrastive LearningData AugmentationMasked Contrastive Pre-Training Improves Music Audio Key Detection
Self-supervised music foundation models underperform on key detection, which requires pitch-sensitive representations. In this work, we present the first systematic study showing that the design of self-supervised pretra…
Data AugmentationSelf-Supervised Contrastive Learning for Robust Audio-Sheet Music Retrieval Systems
Linking sheet music images to audio recordings remains a key problem for the development of efficient cross-modal music retrieval systems. One of the fundamental approaches toward this task is to learn a cross-modal embe…
Contrastive LearningRetrievalAn Experimental Comparison Of Multi-view Self-supervised Methods For Music Tagging
Self-supervised learning has emerged as a powerful way to pre-train generalizable machine learning models on large amounts of unlabeled data. It is particularly compelling in the music domain, where obtaining labeled dat…
Contrastive LearningMusic TaggingSelf-Supervised Learning