A Bi-directional Transformer for Musical Chord Recognition
Chord recognition is an important task since chords are highly abstract and descriptive features of music. For effective chord recognition, it is essential to utilize relevant context in audio sequence. While various machine learning models such as convolutional neural networks (CNNs) and recurrent neural networks (RNNs) have been employed for the task, most of them have limitations in capturing long-term dependency or require training of an additional model. In this work, we utilize a self-attention mechanism for chord recognition to focus on certain regions of chords. Training of the proposed bi-directional Transformer for chord recognition (BTC) consists of a single phase while showing competitive performance. Through an attention map analysis, we have visualized how attention was performed. It turns out that the model was able to divide segments of chords by utilizing adaptive receptive field of the attention mechanism. Furthermore, it was observed that the model was able to effectively capture long-term dependencies, making use of essential information regardless of distance.
Code (3)
Tasks
Chord RecognitionDescriptiveMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ChordFormer: A Conformer-Based Architecture for Large-Vocabulary Audio Chord Recognition
Chord recognition serves as a critical task in music information retrieval due to the abstract and descriptive nature of chords in music analysis. While audio chord recognition systems have achieved significant accuracy …
Chord RecognitionDescriptiveInformation RetrievalMusic Information RetrievalA Fully Convolutional Deep Auditory Model for Musical Chord Recognition
Chord recognition systems depend on robust feature extraction pipelines. While these pipelines are traditionally hand-crafted, recent advances in end-to-end machine learning have begun to inspire researchers to explore d…
Chord RecognitionImproved Chord Recognition by Combining Duration and Harmonic Language Models
Chord recognition systems typically comprise an acoustic model that predicts chords for each audio frame, and a temporal model that casts these predictions into labelled chord segments. However, temporal models have been…
Chord RecognitionLanguage ModelingLanguage ModellingAutomatic Chord Recognition with Higher-Order Harmonic Language Modelling
Common temporal models for automatic chord recognition model chord changes on a frame-wise basis. Due to this fact, they are unable to capture musical knowledge about chord progressions. In this paper, we propose a tempo…
Chord RecognitionLanguage ModellingImproving the Classification of Rare Chords with Unlabeled Data
In this work, we explore techniques to improve performance for rare classes in the task of Automatic Chord Recognition (ACR). We first explored the use of the focal loss in the context of ACR, which was originally propos…
Chord RecognitionClassificationGeneral ClassificationSelf-Learning