ClaudesLens: Uncertainty Quantification in Computer Vision Models
In a world where more decisions are made using artificial intelligence, it is of utmost importance to ensure these decisions are well-grounded. Neural networks are the modern building blocks for artificial intelligence. Modern neural network-based computer vision models are often used for object classification tasks. Correctly classifying objects with \textit{certainty} has become of great importance in recent times. However, quantifying the inherent \textit{uncertainty} of the output from neural networks is a challenging task. Here we show a possible method to quantify and evaluate the uncertainty of the output of different computer vision models based on Shannon entropy. By adding perturbation of different levels, on different parts, ranging from the input to the parameters of the network, one introduces entropy to the system. By quantifying and evaluating the perturbed models on the proposed PI and PSI metrics, we can conclude that our theoretical framework can grant insight into the uncertainty of predictions of computer vision models. We believe that this theoretical framework can be applied to different applications for neural networks. We believe that Shannon entropy may eventually have a bigger role in the SOTA (State-of-the-art) methods to quantify uncertainty in artificial intelligence. One day we might be able to apply Shannon entropy to our neural systems.
Code (1)
Tasks
Uncertainty QuantificationSimilar Papers 제목 키워드 기반
I Find Your Lack of Uncertainty in Computer Vision Disturbing
Neural networks are used for many real world applications, but often they have problems estimating their own confidence. This is particularly problematic for computer vision applications aimed at making high stakes decis…
Out-of-Distribution DetectionUncertainty QuantificationUncertainty Quantification for cross-subject Motor Imagery classification
Uncertainty Quantification aims to determine when the prediction from a Machine Learning model is likely to be wrong. Computer Vision research has explored methods for determining epistemic uncertainty (also known as mod…
Brain Computer InterfaceClassificationMotor ImageryUncertainty QuantificationUncertainties of Latent Representations in Computer Vision
Uncertainty quantification is a key pillar of trustworthy machine learning. It enables safe reactions under unsafe inputs, like predicting only when the machine learning model detects sufficient evidence, discarding anom…
image-classificationImage ClassificationMedical Image ClassificationRepresentation Learning+2Real-Time Uncertainty Estimation in Computer Vision via Uncertainty-Aware Distribution Distillation
Calibrated estimates of uncertainty are critical for many real-world computer vision applications of deep learning. While there are several widely-used uncertainty estimation methods, dropout inference stands out for its…
Depth EstimationSemantic SegmentationUncertainty QuantificationConfident magnitude-based neural network pruning
Pruning neural networks has proven to be a successful approach to increase the efficiency and reduce the memory storage of deep learning models without compromising performance. Previous literature has shown that it is p…
Network PruningUncertainty Quantification