MISNN: Multiple Imputation via Semi-parametric Neural Networks
Multiple imputation (MI) has been widely applied to missing value problems in biomedical, social and econometric research, in order to avoid improper inference in the downstream data analysis. In the presence of high-dimensional data, imputation models that include feature selection, especially $\ell_1$ regularized regression (such as Lasso, adaptive Lasso, and Elastic Net), are common choices to prevent the model from underdetermination. However, conducting MI with feature selection is difficult: existing methods are often computationally inefficient and poor in performance. We propose MISNN, a novel and efficient algorithm that incorporates feature selection for MI. Leveraging the approximation power of neural networks, MISNN is a general and flexible framework, compatible with any feature selection method, any neural network architecture, high/low-dimensional data and general missing patterns. Through empirical experiments, MISNN has demonstrated great advantages over state-of-the-art imputation methods (e.g. Bayesian Lasso and matrix completion), in terms of imputation accuracy, statistical consistency and computation speed.
Code (0)
등록된 구현이 없습니다.
Tasks
feature selectionImputationMatrix CompletionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Distributionally Faithful Imputation via Positive Semi-Definite Kernel Density Estimation
Missing values undermine statistical inference and machine learning pipelines, yet most imputation methods rely on heuristics or restrictive parametric assumptions that ignore the joint data distribution. We recast imput…
Density EstimationStatistical inference using Regularized M-estimation in the reproducing kernel Hilbert space for handling missing data
Imputation and propensity score weighting are two popular techniques for handling missing data. We address these problems using the regularized M-estimation techniques in the reproducing kernel Hilbert space. Specificall…
ImputationregressionMultiple imputation using chained random forests: a preliminary study based on the empirical distribution of out-of-bag prediction errors
Missing data are common in data analyses in biomedical fields, and imputation methods based on random forests (RF) have become widely accepted, as the RF algorithm can achieve high accuracy without the need for specifica…
ImputationPredictionvalidMasking criteria for selecting an imputation model
The masking-one-out (MOO) procedure, masking an observed entry and comparing it versus its imputed values, is a very common procedure for comparing imputation models. We study the optimum of this procedure and generalize…
Semi-Parametric Inducing Point Networks and Neural Processes
We introduce semi-parametric inducing point networks (SPIN), a general-purpose architecture that can query the training set at inference time in a compute-efficient manner. Semi-parametric architectures are typically mor…
ImputationMeta-Learning