An Uncertainty-aware Loss Function for Training Neural Networks with Calibrated Predictions
Uncertainty quantification of machine learning and deep learning methods plays an important role in enhancing trust to the obtained result. In recent years, a numerous number of uncertainty quantification methods have been introduced. Monte Carlo dropout (MC-Dropout) is one of the most well-known techniques to quantify uncertainty in deep learning methods. In this study, we propose two new loss functions by combining cross entropy with Expected Calibration Error (ECE) and Predictive Entropy (PE). The obtained results clearly show that the new proposed loss functions lead to having a calibrated MC-Dropout method. Our results confirmed the great impact of the new hybrid loss functions for minimising the overlap between the distributions of uncertainty estimates for correct and incorrect predictions without sacrificing the model's overall performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningUncertainty QuantificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhancing Trust in Large Language Models with Uncertainty-Aware Fine-Tuning
Large language models (LLMs) have revolutionized the field of natural language processing with their impressive reasoning and question-answering capabilities. However, these models are sometimes prone to generating credi…
Causal Language ModelingLanguage ModelingLanguage ModellingQuestion Answering+2Rethinking Gaussian Trajectory Predictors: Calibrated Uncertainty for Safe Planning
Accurate trajectory prediction is critical for safe autonomous navigation in crowded environments. While many trajectory predictors output Gaussian distributions to represent the multi-modal distribution over future pede…
Trajectory PredictionDensity EstimationMotion PlanningCalibrated Value-Aware Model Learning with Stochastic Environment Models
The idea of value-aware model learning, that models should produce accurate value estimates, has gained prominence in model-based reinforcement learning. The MuZero loss, which penalizes a model's value function predicti…
Model-based Reinforcement LearningCredibility-Aware Learning and Control for Safe USV Navigation under Perception Uncertainty
Safe navigation for Unmanned Surface Vehicles (USVs) under the International Regulations for Preventing Collisions at Sea (COLREGs) remains challenging in dynamic maritime environments, especially when perception uncerta…
Reinforcement LearningCollision AvoidanceBeyond Prediction: Interval Neural Networks for Uncertainty-Aware System Identification
System identification (SysID) is critical for modeling dynamical systems from experimental data, yet traditional approaches often fail to capture nonlinear behaviors. While deep learning offers powerful tools for modelin…