paper-with-me

홈 › Papers

ChordFormer: A Conformer-Based Architecture for Large-Vocabulary Audio Chord Recognition

2025-02-17 · Muhammad Waseem Akram, Stefano Dettori, Valentina Colla, Giorgio Carlo Buttazzo

Chord recognition serves as a critical task in music information retrieval due to the abstract and descriptive nature of chords in music analysis. While audio chord recognition systems have achieved significant accuracy for small vocabularies (e.g., major/minor chords), large-vocabulary chord recognition remains a challenging problem. This complexity also arises from the inherent long-tail distribution of chords, where rare chord types are underrepresented in most datasets, leading to insufficient training samples. Effective chord recognition requires leveraging contextual information from audio sequences, yet existing models, such as combinations of convolutional neural networks, bidirectional long short-term memory networks, and bidirectional transformers, face limitations in capturing long-term dependencies and exhibit suboptimal performance on large-vocabulary chord recognition tasks. This work proposes ChordFormer, a novel conformer-based architecture designed to tackle structural chord recognition (e.g., triads, bass, sevenths) for large vocabularies. ChordFormer leverages conformer blocks that integrate convolutional neural networks with transformers, thus enabling the model to capture both local patterns and global dependencies effectively. By addressing challenges such as class imbalance through a reweighted loss function and structured chord representations, ChordFormer outperforms state-of-the-art models, achieving a 2% improvement in frame-wise accuracy and a 6% increase in class-wise accuracy on large-vocabulary chord datasets. Furthermore, ChordFormer excels in handling class imbalance, providing robust and balanced recognition across chord types. This approach bridges the gap between theoretical music knowledge and practical applications, advancing the field of large-vocabulary chord recognition.

📄 PDF Abstract BibTeX arXiv:2502.11840

Code (0)

등록된 구현이 없습니다.

Tasks

Chord RecognitionDescriptiveInformation RetrievalMusic Information Retrieval

Similar Papers 제목 키워드 기반

Audio-Visual Efficient Conformer for Robust Speech Recognition

2023-01-04 · Maxime Burchi, Radu Timofte

End-to-end Automatic Speech Recognition (ASR) systems based on neural networks have seen large improvements in recent years. The availability of large scale hand-labeled datasets and sufficient computing resources made i…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Lip ReadingRobust Speech Recognition+2

Cross-attention conformer for context modeling in speech enhancement for ASR

2021-10-30 · Arun Narayanan, Chung-Cheng Chiu, Tom O'Malley, Quan Wang 외

This work introduces \emph{cross-attention conformer}, an attention-based architecture for context modeling in speech enhancement. Given that the context information can often be sequential, and of different length as th…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speech Enhancementspeech-recognition+1

Synthetic Voice Detection and Audio Splicing Detection using SE-Res2Net-Conformer Architecture

2022-10-07 · Lei Wang, Benedict Yeoh, Jun Wah Ng

Synthetic voice and splicing audio clips have been generated to spoof Internet users and artificial intelligence (AI) technologies such as voice authentication. Existing research work treats spoofing countermeasures as a…

Binary Classification

Conformer-Based Self-Supervised Learning for Non-Speech Audio Tasks

2021-10-14 · Sangeeta Srivastava, Yun Wang, Andros Tjandra, Anurag Kumar 외

Representation learning from unlabeled data has been of major interest in artificial intelligence research. While self-supervised speech representation learning has been popular in the speech research community, very few…

Audio ClassificationRepresentation LearningSelf-Supervised LearningSpeech Representation Learning

End-to-end Audio-visual Speech Recognition with Conformers

2021-02-12 · Pingchuan Ma, Stavros Petridis, Maja Pantic

In this work, we present a hybrid CTC/Attention model based on a ResNet-18 and Convolution-augmented transformer (Conformer), that can be trained in an end-to-end manner. In particular, the audio and visual encoders lear…

Audio-Visual Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+6