Enabling Uncertainty Estimation in Iterative Neural Networks
Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of their successive outputs is highly correlated with the accuracy of the value to which they converge. Thus, we can use the convergence rate as a useful proxy for uncertainty. This results in an approach to uncertainty estimation that provides state-of-the-art estimates at a much lower computational cost than techniques like Ensembles, and without requiring any modifications to the original iterative model. We demonstrate its practical value by embedding it in two application domains: road detection in aerial images and the estimation of aerodynamic properties of 2D and 3D shapes.
Code (1)
Tasks
Bayesian OptimizationOut-of-Distribution DetectionUncertainty QuantificationSimilar Papers 제목 키워드 기반
Uncertainty Model Estimation in an Augmented Data Space for Robust State Estimation
The requirement to generate robust robotic platforms is a critical enabling step to allow such platforms to permeate safety-critical applications (i.e., the localization of autonomous platforms in urban environments). On…
State EstimationRobust Neural Regression via Uncertainty Learning
Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution d…
regressionPhysGS: Bayesian-Inferred Gaussian Splatting for Physical Property Estimation
Understanding physical properties such as friction, stiffness, hardness, and material composition is essential for enabling robots to interact safely and effectively with their surroundings. However, existing 3D reconstr…
Bayesian Inference3D ReconstructionBayesian E(3)-Equivariant Interatomic Potential with Iterative Restratification of Many-body Message Passing
Machine learning potentials (MLPs) have become essential for large-scale atomistic simulations, enabling ab initio-level accuracy with computational efficiency. However, current MLPs struggle with uncertainty quantificat…
Computational EfficiencyActive LearningIterative Distillation for Better Uncertainty Estimates in Multitask Emotion Recognition
When recognizing emotions, subtle nuances in displays of emotion generate ambiguity or uncertainty in emotion perception. Emotion uncertainty has been previously interpreted as inter-rater disagreement among multiple ann…
Emotion Recognition