Conformal Prediction Intervals for Markov Decision Process Trajectories
Before delegating a task to an autonomous system, a human operator may want a guarantee about the behavior of the system. This paper extends previous work on conformal prediction for functional data and conformalized quantile regression to provide conformal prediction intervals over the future behavior of an autonomous system executing a fixed control policy on a Markov Decision Process (MDP). The prediction intervals are constructed by applying conformal corrections to prediction intervals computed by quantile regression. The resulting intervals guarantee that with probability $1-\delta$ the observed trajectory will lie inside the prediction interval, where the probability is computed with respect to the starting state distribution and the stochasticity of the MDP. The method is illustrated on MDPs for invasive species management and StarCraft2 battles.
Code (0)
등록된 구현이 없습니다.
Tasks
Conformal PredictionManagementPredictionPrediction Intervalsquantile regressionregressionSimilar Papers 제목 키워드 기반
CASCADE Conformal Prediction: Uncertainty-Adaptive Prediction Intervals for Two-Stage Clinical Decision Support
Effective medication management in Parkinson's Disease (PD) is challenging due to heterogeneous disease progression, variable patient response, and medication side effects. While AI models can forecast levodopa equivalen…
Conditional validity of heteroskedastic conformal regression
Conformal prediction, and split conformal prediction as a specific implementation, offer a distribution-free approach to estimating prediction intervals with statistical guarantees. Recent work has shown that split confo…
Conformal PredictionPredictionPrediction IntervalsregressionConformal Regression in Calorie Prediction for Team Jumbo-Visma
UCI WorldTour races, the premier men's elite road cycling tour, are grueling events that put physical fitness and endurance of riders to the test. The coaches of Team Jumbo-Visma have long been responsible for predicting…
Conformal PredictionDecision MakingPredictionPrediction Intervals+2Conformal Off-Policy Evaluation in Markov Decision Processes
Reinforcement Learning aims at identifying and evaluating efficient control policies from data. In many real-world applications, the learner is not allowed to experiment and cannot gather data in an online manner (this i…
Conformal PredictionOff-policy evaluationConformal Approach To Gaussian Process Surrogate Evaluation With Coverage Guarantees
Gaussian processes (GPs) are a Bayesian machine learning approach widely used to construct surrogate models for the uncertainty quantification of computer simulation codes in industrial applications. It provides both a m…
Conformal PredictionGaussian ProcessesPredictionPrediction Intervals+1