HDI-Forest: Highest Density Interval Regression Forest
By seeking the narrowest prediction intervals (PIs) that satisfy the specified coverage probability requirements, the recently proposed quality-based PI learning principle can extract high-quality PIs that better summarize the predictive certainty in regression tasks, and has been widely applied to solve many practical problems. Currently, the state-of-the-art quality-based PI estimation methods are based on deep neural networks or linear models. In this paper, we propose Highest Density Interval Regression Forest (HDI-Forest), a novel quality-based PI estimation method that is instead based on Random Forest. HDI-Forest does not require additional model training, and directly reuses the trees learned in a standard Random Forest model. By utilizing the special properties of Random Forest, HDI-Forest could efficiently and more directly optimize the PI quality metrics. Extensive experiments on benchmark datasets show that HDI-Forest significantly outperforms previous approaches, reducing the average PI width by over 20% while achieving the same or better coverage probability
Code (1)
Tasks
Prediction IntervalsregressionSimilar Papers 제목 키워드 기반
Crop yield probability density forecasting via quantile random forest and Epanechnikov Kernel function
A reliable and accurate forecasting model for crop yields is of crucial importance for efficient decision-making process in the agricultural sector. However, due to weather extremes and uncertainties, most forecasting mo…
Decision MakingDensity EstimationFeature ImportancePrediction+3Uncertainty Quantification in Ensembles of Honest Regression Trees using Generalized Fiducial Inference
Due to their accuracies, methods based on ensembles of regression trees are a popular approach for making predictions. Some common examples include Bayesian additive regression trees, boosting and random forests. This pa…
Prediction IntervalsregressionUncertainty QuantificationSimultaneous Inference for Local Structural Parameters with Random Forests
We construct simultaneous confidence intervals for solutions to conditional moment equations. The intervals are built around a class of nonparametric regression algorithms based on subsampled kernels. This class encompas…
Causal InferenceregressionLocal Linear Forests
Random forests are a powerful method for non-parametric regression, but are limited in their ability to fit smooth signals, and can show poor predictive performance in the presence of strong, smooth effects. Taking the p…
Causal InferenceHeterogeneous Treatment Effect EstimationregressionvalidRFCDE: Random Forests for Conditional Density Estimation
Random forests is a common non-parametric regression technique which performs well for mixed-type data and irrelevant covariates, while being robust to monotonic variable transformations. Existing random forest implement…
Density EstimationGeneral Classificationregression