Beat this! Accurate beat tracking without DBN postprocessing
We propose a system for tracking beats and downbeats with two objectives: generality across a diverse music range, and high accuracy. We achieve generality by training on multiple datasets -- including solo instrument recordings, pieces with time signature changes, and classical music with high tempo variations -- and by removing the commonly used Dynamic Bayesian Network (DBN) postprocessing, which introduces constraints on the meter and tempo. For high accuracy, among other improvements, we develop a loss function tolerant to small time shifts of annotations, and an architecture alternating convolutions with transformers either over frequency or time. Our system surpasses the current state of the art in F1 score despite using no DBN. However, it can still fail, especially for difficult and underrepresented genres, and performs worse on continuity metrics, so we publish our model, code, and preprocessed datasets, and invite others to beat this.
Code (1)
Tasks
Beat TrackingDownbeat TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Singing Beat Tracking With Self-supervised Front-end and Linear Transformers
Tracking beats of singing voices without the presence of musical accompaniment can find many applications in music production, automatic song arrangement, and social media interaction. Its main challenge is the lack of s…
Beat TrackingDon't look back: an online beat tracking method using RNN and enhanced particle filtering
Online beat tracking (OBT) has always been a challenging task. Due to the inaccessibility of future data and the need to make inference in real-time. We propose Do not Look back! (DLB), a novel approach optimized for eff…
Beat TrackingOnline Beat TrackingA Contrastive Self-Supervised Learning scheme for beat tracking amenable to few-shot learning
In this paper, we propose a novel Self-Supervised-Learning scheme to train rhythm analysis systems and instantiate it for few-shot beat tracking. Taking inspiration from the Contrastive Predictive Coding paradigm, we pro…
Beat TrackingFew-Shot LearningRhythmSelf-Supervised LearningBeat and Downbeat Tracking in Performance MIDI Using an End-to-End Transformer Architecture
Beat tracking in musical performance MIDI is a challenging and important task for notation-level music transcription and rhythmical analysis, yet existing methods primarily focus on audio-based approaches. This paper pro…
Music TranscriptionDownbeat TrackingWaveBeat: End-to-end beat and downbeat tracking in the time domain
Deep learning approaches for beat and downbeat tracking have brought advancements. However, these approaches continue to rely on hand-crafted, subsampled spectral features as input, restricting the information available …
Data AugmentationDownbeat Tracking