A Latent Space Metric for Enhancing Prediction Confidence in Earth Observation Data
This study presents a new approach for estimating confidence in machine learning model predictions, specifically in regression tasks utilizing Earth Observation (EO) data, with a particular focus on mosquito abundance (MA) estimation. We take advantage of a Variational AutoEncoder architecture, to derive a confidence metric by the latent space representations of EO datasets. This methodology is pivotal in establishing a correlation between the Euclidean distance in latent representations and the Absolute Error (AE) in individual MA predictions. Our research focuses on EO datasets from the Veneto region in Italy and the Upper Rhine Valley in Germany, targeting areas significantly affected by mosquito populations. A key finding is a notable correlation of 0.46 between the AE of MA predictions and the proposed confidence metric. This correlation signifies a robust, new metric for quantifying the reliability and enhancing the trustworthiness of the AI model's predictions in the context of both EO data analysis and mosquito abundance studies.
Code (0)
등록된 구현이 없습니다.
Tasks
Earth ObservationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Trustworthy Intrusion Detection: Confidence Estimation Using Latent Space
This work introduces a novel method for enhancing confidence in anomaly detection in Intrusion Detection Systems (IDS) through the use of a Variational Autoencoder (VAE) architecture. By developing a confidence metric de…
Anomaly DetectionBinary ClassificationIntrusion DetectionUncertainty Quantification in Deep Neural Networks through Statistical Inference on Latent Space
Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this probl…
Uncertainty QuantificationCalibrated neighborhood aware confidence measure for deep metric learning
Deep metric learning has gained promising improvement in recent years following the success of deep learning. It has been successfully applied to problems in few-shot learning, image retrieval, and open-set classificatio…
Few-Shot LearningImage RetrievalMetric LearningRetrievalImproving Explainability of Softmax Classifiers Using a Prototype-Based Joint Embedding Method
We propose a prototype-based approach for improving explainability of softmax classifiers that provides an understandable prediction confidence, generated through stochastic sampling of prototypes, and demonstrates poten…
Explainable Artificial Intelligence (XAI)Out-of-Distribution DetectionGenerate Novel Molecules With Target Properties Using Conditional Generative Models
Drug discovery using deep learning has attracted a lot of attention of late as it has obvious advantages like higher efficiency, less manual guessing and faster process time. In this paper, we present a novel neural netw…
DecoderDrug DiscoveryProperty Prediction