Regression-based Melody Estimation with Uncertainty Quantification
Existing machine learning models approach the task of melody estimation from polyphonic audio as a classification problem by discretizing the pitch values, which results in the loss of finer frequency variations present in the melody. To better capture these variations, we propose to approach this task as a regression problem. Apart from predicting only the pitch for a particular region in the audio, we also predict its uncertainty to enhance the trustworthiness of the model. To perform regression-based melody estimation, we propose three different methods that use histogram representation to model the pitch values. Such a representation requires the support range of the histogram to be continuous. The first two methods address the abrupt discontinuity between unvoiced and voiced frequency ranges by mapping them to a continuous range. The third method reformulates melody estimation as a fully Bayesian task, modeling voicing detection as a classification problem, and voiced pitch estimation as a regression problem. Additionally, we introduce a novel method to estimate the uncertainty from the histogram representation that correlates well with the deviation of the mean of the predicted distribution from the ground truth. Experimental results demonstrate that reformulating melody estimation as a regression problem significantly improves the performance over classification-based approaches. Comparing the proposed methods with a state-of-the-art regression model, it is observed that the Bayesian method performs the best at estimating both the melody and its associated uncertainty.
Code (1)
Tasks
regressionUncertainty QuantificationSimilar Papers 제목 키워드 기반
On Monocular Depth Estimation and Uncertainty Quantification using Classification Approaches for Regression
Monocular depth is important in many tasks, such as 3D reconstruction and autonomous driving. Deep learning based models achieve state-of-the-art performance in this field. A set of novel approaches for estimating monocu…
3D ReconstructionAutonomous DrivingDepth EstimationMonocular Depth Estimation+2Uncertainty separation via ensemble quantile regression
This paper introduces a novel and scalable framework for uncertainty estimation and separation with applications in data driven modeling in science and engineering tasks where reliable uncertainty quantification is criti…
quantile regressionregressionUncertainty QuantificationDiscretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regression
Uncertainty quantification is critical for deploying deep neural networks (DNNs) in real-world applications. An Auxiliary Uncertainty Estimator (AuxUE) is one of the most effective means to estimate the uncertainty of th…
Age EstimationDepth Aleatoric Uncertainty EstimationDepth EstimationMonocular Depth Estimation+4Continuous Normalizing Flows for Uncertainty-Aware Human Pose Estimation
Human Pose Estimation (HPE) is increasingly important for applications like virtual reality and motion analysis, yet current methods struggle with balancing accuracy, computational efficiency, and reliable uncertainty qu…
3D Human Pose EstimationComputational EfficiencyPose Estimationregression+1Uncertainty Quantification with Deep Ensembles for 6D Object Pose Estimation
The estimation of 6D object poses is a fundamental task in many computer vision applications. Particularly, in high risk scenarios such as human-robot interaction, industrial inspection, and automation, reliable pose est…
6D Pose Estimation using RGBObjectPose EstimationUncertainty Quantification