Regression Conformal Prediction with Nearest Neighbours
In this paper we apply Conformal Prediction (CP) to the k-Nearest Neighbours Regression (k-NNR) algorithm and propose ways of extending the typical nonconformity measure used for regression so far. Unlike traditional regression methods which produce point predictions, Conformal Predictors output predictive regions that satisfy a given confidence level. The regions produced by any Conformal Predictor are automatically valid, however their tightness and therefore usefulness depends on the nonconformity measure used by each CP. In effect a nonconformity measure evaluates how strange a given example is compared to a set of other examples based on some traditional machine learning algorithm. We define six novel nonconformity measures based on the k-Nearest Neighbours Regression algorithm and develop the corresponding CPs following both the original (transductive) and the inductive CP approaches. A comparison of the predictive regions produced by our measures with those of the typical regression measure suggests that a major improvement in terms of predictive region tightness is achieved by the new measures.
Code (0)
등록된 구현이 없습니다.
Tasks
Conformal PredictionPredictionregressionvalidSimilar Papers 제목 키워드 기반
Target Strangeness: A Novel Conformal Prediction Difficulty Estimator
This paper introduces Target Strangeness, a novel difficulty estimator for conformal prediction (CP) that offers an alternative approach for normalizing prediction intervals (PIs). By assessing how atypical a prediction …
Conformal PredictionPredictionPrediction IntervalsregressionApplying Regression Conformal Prediction with Nearest Neighbors to time series data
In this paper, we apply conformal prediction to time series data. Conformal prediction isa method that produces predictive regions given a confidence level. The regions outputs arealways valid under the exchangeability a…
Conformal PredictionPredictionPrediction Intervalsregression+3Fast Computation of Leave-One-Out Cross-Validation for $k$-NN Regression
We describe a fast computation method for leave-one-out cross-validation (LOOCV) for $k$-nearest neighbours ($k$-NN) regression. We show that, under a tie-breaking condition for nearest neighbours, the LOOCV estimate of …
regressionAn Efficient Algorithm for Bayesian Nearest Neighbours
K-Nearest Neighbours (k-NN) is a popular classification and regression algorithm, yet one of its main limitations is the difficulty in choosing the number of neighbours. We present a Bayesian algorithm to compute the pos…
Change Point DetectionGeneral ClassificationregressionThe Theory and Practice of Highly Scalable Gaussian Process Regression with Nearest Neighbours
Gaussian process ($GP$) regression is a widely used non-parametric modeling tool, but its cubic complexity in the training size limits its use on massive data sets. A practical remedy is to predict using only the nearest…