Combining Prediction Intervals on Multi-Source Non-Disclosed Regression Datasets
Conformal Prediction is a framework that produces prediction intervals based on the output from a machine learning algorithm. In this paper we explore the case when training data is made up of multiple parts available in different sources that cannot be pooled. We here consider the regression case and propose a method where a conformal predictor is trained on each data source independently, and where the prediction intervals are then combined into a single interval. We call the approach Non-Disclosed Conformal Prediction (NDCP), and we evaluate it on a regression dataset from the UCI machine learning repository using support vector regression as the underlying machine learning algorithm, with varying number of data sources and sizes. The results show that the proposed method produces conservatively valid prediction intervals, and while we cannot retain the same efficiency as when all data is used, efficiency is improved through the proposed approach as compared to predicting using a single arbitrarily chosen source.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningConformal PredictionPredictionPrediction IntervalsregressionvalidSimilar Papers 제목 키워드 기반
Aggregating Predictions on Multiple Non-disclosed Datasets using Conformal Prediction
Conformal Prediction is a machine learning methodology that produces valid prediction regions under mild conditions. In this paper, we explore the application of making predictions over multiple data sources of different…
Conformal PredictionPredictionvalidEnhancing reliability in prediction intervals using point forecasters: Heteroscedastic Quantile Regression and Width-Adaptive Conformal Inference
Constructing prediction intervals for time series forecasting is challenging, particularly when practitioners rely solely on point forecasts. While previous research has focused on creating increasingly efficient interva…
PredictionPrediction Intervalsquantile regressionTime Series+2Conformalized-DeepONet: A Distribution-Free Framework for Uncertainty Quantification in Deep Operator Networks
In this paper, we adopt conformal prediction, a distribution-free uncertainty quantification (UQ) framework, to obtain confidence prediction intervals with coverage guarantees for Deep Operator Network (DeepONet) regress…
Conformal PredictionPredictionPrediction Intervalsregression+1A Deep Generative Model Imitating Predictive Coding in Human Brain
In recent years, the development of deep generative models for prediction has been attracting attention. In our study, we focus on predictive coding, a concept from the neuroscience literature that hypothesizes the brain…
PredictionPrediction IntervalsTime-Conditioned and Multi-Time Survival Prediction from 2D PET/CT Projections in Lung Cancer
Accurate prediction of overall survival (OS) from positron emission tomography/computed tomography (PET/CT) can support personalized treatment and follow-up strategies in oncology. However, the impact of temporal modelin…