paper-with-me

Papers

Regression Conformal Prediction with Nearest Neighbours

2014-01-16 · Harris Papadopoulos, Vladimir Vovk, Alex Gammerman

In this paper we apply Conformal Prediction (CP) to the k-Nearest Neighbours Regression (k-NNR) algorithm and propose ways of extending the typical nonconformity measure used for regression so far. Unlike traditional regression methods which produce point predictions, Conformal Predictors output predictive regions that satisfy a given confidence level. The regions produced by any Conformal Predictor are automatically valid, however their tightness and therefore usefulness depends on the nonconformity measure used by each CP. In effect a nonconformity measure evaluates how strange a given example is compared to a set of other examples based on some traditional machine learning algorithm. We define six novel nonconformity measures based on the k-Nearest Neighbours Regression algorithm and develop the corresponding CPs following both the original (transductive) and the inductive CP approaches. A comparison of the predictive regions produced by our measures with those of the typical regression measure suggests that a major improvement in terms of predictive region tightness is achieved by the new measures.

📄 PDF Abstract BibTeX arXiv:1401.3880

Code (0)

등록된 구현이 없습니다.

Tasks

Conformal PredictionPredictionregressionvalid

Similar Papers 제목 키워드 기반

Target Strangeness: A Novel Conformal Prediction Difficulty Estimator

2024-10-24 · Alexis Bose, Jonathan Ethier, Paul Guinand

This paper introduces Target Strangeness, a novel difficulty estimator for conformal prediction (CP) that offers an alternative approach for normalizing prediction intervals (PIs). By assessing how atypical a prediction …

Conformal PredictionPredictionPrediction Intervalsregression

Applying Regression Conformal Prediction with Nearest Neighbors to time series data

2021-10-25 · Samya Tajmouati, Bouazza El Wahbi, Mohammed Dakkoun

In this paper, we apply conformal prediction to time series data. Conformal prediction isa method that produces predictive regions given a confidence level. The regions outputs arealways valid under the exchangeability a…

Conformal PredictionPredictionPrediction Intervalsregression+3

Fast Computation of Leave-One-Out Cross-Validation for $k$-NN Regression

2024-05-08 · Motonobu Kanagawa

We describe a fast computation method for leave-one-out cross-validation (LOOCV) for $k$-nearest neighbours ($k$-NN) regression. We show that, under a tie-breaking condition for nearest neighbours, the LOOCV estimate of …

regression

An Efficient Algorithm for Bayesian Nearest Neighbours

2017-05-26 · Giuseppe Nuti

K-Nearest Neighbours (k-NN) is a popular classification and regression algorithm, yet one of its main limitations is the difficulty in choosing the number of neighbours. We present a Bayesian algorithm to compute the pos…

Change Point DetectionGeneral Classificationregression

The Theory and Practice of Highly Scalable Gaussian Process Regression with Nearest Neighbours

2026-04-08 · Robert Allison, Tomasz Maciazek, Anthony Stephenson arxiv

Gaussian process ($GP$) regression is a widely used non-parametric modeling tool, but its cubic complexity in the training size limits its use on massive data sets. A practical remedy is to predict using only the nearest…