paper-with-me

홈 › Papers

Self-Similarity-Based and Novelty-based loss for music structure analysis

2023-09-05 · Geoffroy Peeters

Music Structure Analysis (MSA) is the task aiming at identifying musical segments that compose a music track and possibly label them based on their similarity. In this paper we propose a supervised approach for the task of music boundary detection. In our approach we simultaneously learn features and convolution kernels. For this we jointly optimize -- a loss based on the Self-Similarity-Matrix (SSM) obtained with the learned features, denoted by SSM-loss, and -- a loss based on the novelty score obtained applying the learned kernels to the estimated SSM, denoted by novelty-loss. We also demonstrate that relative feature learning, through self-attention, is beneficial for the task of MSA. Finally, we compare the performances of our approach to previously proposed approaches on the standard RWC-Pop, and various subsets of SALAMI.

📄 PDF Abstract BibTeX arXiv:2309.02243

Code (2)

geoffroypeeters/ssmnet_ISMIR2023 공식 구현 pytorch
keshavbhandari/improvnet pytorch

Tasks

Boundary Detection

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

SSM-Net: feature learning for Music Structure Analysis using a Self-Similarity-Matrix based loss

2022-11-15 · Geoffroy Peeters, Florian Angulo

In this paper, we propose a new paradigm to learn audio features for Music Structure Analysis (MSA). We train a deep encoder to learn features such that the Self-Similarity-Matrix (SSM) resulting from those approximates …

Musical Audio Similarity with Self-supervised Convolutional Neural Networks

2022-02-04 · Carl Thomé, Sebastian Piwell, Oscar Utterbäck

We have built a music similarity search engine that lets video producers search by listenable music excerpts, as a complement to traditional full-text search. Our system suggests similar sounding track segments in a larg…

Triplet

Artist Similarity with Graph Neural Networks

2021-07-30 · Filip Korzeniowski, Sergio Oramas, Fabien Gouyon

Artist similarity plays an important role in organizing, understanding, and subsequently, facilitating discovery in large collections of music. In this paper, we present a hybrid approach to computing similarity between …

Graph Neural NetworkTriplet

Self-supervised Auxiliary Loss for Metric Learning in Music Similarity-based Retrieval and Auto-tagging

2023-04-15 · Taketo Akama, Hiroaki Kitano, Katsuhiro Takematsu, Yasushi Miyajima 외

In the realm of music information retrieval, similarity-based retrieval and auto-tagging serve as essential components. Given the limitations and non-scalability of human supervision signals, it becomes crucial for model…

Information RetrievalMetric LearningMusic Information RetrievalRetrieval+1

Generating Music with Structure Using Self-Similarity as Attention

2024-06-21 · Sophia Hager, Kathleen Hablutzel, Katherine M. Kinnaird

Despite the innovations in deep learning and generative AI, creating long term structure as well as the layers of repeated structure common in musical works remains an open challenge in music generation. We propose an at…

Music Generation