Multiple imputation using chained random forests: a preliminary study based on the empirical distribution of out-of-bag prediction errors
Missing data are common in data analyses in biomedical fields, and imputation methods based on random forests (RF) have become widely accepted, as the RF algorithm can achieve high accuracy without the need for specification of data distributions or relationships. However, the predictions from RF do not contain information about prediction uncertainty, which was unacceptable for multiple imputation. Available RF-based multiple imputation methods tried to do proper multiple imputation either by sampling directly from observations under predicting nodes without accounting for the prediction error or by making normality assumption about the prediction error distribution. In this study, a novel RF-based multiple imputation method was proposed by constructing conditional distributions the empirical distribution of out-of-bag prediction errors. The proposed method was compared with previous method with parametric assumptions about RF's prediction errors and predictive mean matching based on simulation studies on data with presence of interaction term. The proposed non-parametric method can deliver valid multiple imputation results. The accompanying R package for this study is publicly available.
Code (1)
Tasks
ImputationPredictionvalidSimilar Papers 제목 키워드 기반
Evaluating tree-based imputation methods as an alternative to MICE PMM for drawing inference in empirical studies
Dealing with missing data is an important problem in statistical analysis that is often addressed with imputation procedures. The performance and validity of such methods are of great importance for their application in …
ImputationAre deep learning models superior for missing data imputation in large surveys? Evidence from an empirical comparison
Multiple imputation (MI) is a popular approach for dealing with missing data arising from non-response in sample surveys. Multiple imputation by chained equations (MICE) is one of the most widely used MI algorithms for m…
Deep LearningDenoisingImputationAdapting tree-based multiple imputation methods for multi-level data? A simulation study
When data have a hierarchical structure, such as students nested within classrooms, ignoring dependencies between observations can compromise the validity of imputation procedures. Standard tree-based imputation methods …
ImputationMissing value imputation with adversarial random forests -- MissARF
Handling missing values is a common challenge in biostatistical analyses, typically addressed by imputation methods. We propose a novel, fast, and easy-to-use imputation method called missing value imputation with advers…
Density EstimationImputationMissing ValuesMultiple imputation using chained equations: issues and guidance for practice
Multiple imputation by chained equations (MICE) is a flexible and practical approach to handling missing data. We describe the principles of the method and show how to impute categorical and quantitative variables, inclu…
ImputationMultivariate Time Series Imputation