Reliable Prediction Intervals with Directly Optimized Inductive Conformal Regression for Deep Learning
By generating prediction intervals (PIs) to quantify the uncertainty of each prediction in deep learning regression, the risk of wrong predictions can be effectively controlled. High-quality PIs need to be as narrow as possible, whilst covering a preset proportion of real labels. At present, many approaches to improve the quality of PIs can effectively reduce the width of PIs, but they do not ensure that enough real labels are captured. Inductive Conformal Predictor (ICP) is an algorithm that can generate effective PIs which is theoretically guaranteed to cover a preset proportion of data. However, typically ICP is not directly optimized to yield minimal PI width. However, in this study, we use Directly Optimized Inductive Conformal Regression (DOICR) that takes only the average width of PIs as the loss function and increases the quality of PIs through an optimized scheme under the validity condition that sufficient real labels are captured in the PIs. Benchmark experiments show that DOICR outperforms current state-of-the-art algorithms for regression problems using underlying Deep Neural Network structures for both tabular and image data.
Code (0)
등록된 구현이 없습니다.
Tasks
Prediction IntervalsregressionSimilar Papers 제목 키워드 기반
Sequential inductive prediction intervals
In this paper we explore the concept of sequential inductive prediction intervals using theory from sequential testing. We furthermore introduce a 3-parameter PAC definition of prediction intervals that allows us via sim…
PredictionPrediction IntervalsReliable Probability Intervals For Classification Using Inductive Venn Predictors Based on Distance Learning
Deep neural networks are frequently used by autonomous systems for their ability to learn complex, non-linear data patterns and make accurate predictions in dynamic environments. However, their use as black boxes introdu…
image-classificationImage ClassificationMetric LearningConformal Regression in Calorie Prediction for Team Jumbo-Visma
UCI WorldTour races, the premier men's elite road cycling tour, are grueling events that put physical fitness and endurance of riders to the test. The coaches of Team Jumbo-Visma have long been responsible for predicting…
Conformal PredictionDecision MakingPredictionPrediction Intervals+2Extreme Conformal Prediction: Reliable Intervals for High-Impact Events
Conformal prediction is a popular method to construct prediction intervals for black-box machine learning models with marginal coverage guarantees. In applications with potentially high-impact events, such as flooding or…
Conformal PredictionPredictionPrediction Intervalsquantile regressionRelation-dependent Contrastive Learning with Cluster Sampling for Inductive Relation Prediction
Relation prediction is a task designed for knowledge graph completion which aims to predict missing relationships between entities. Recent subgraph-based models for inductive relation prediction have received increasing …
Contrastive LearningInductive Relation PredictionKnowledge Graph CompletionPrediction+3