paper-with-me

홈 › Papers

Missing Data Imputation for Classification Problems

2020-02-25 · Arkopal Choudhury, Michael R. Kosorok

Imputation of missing data is a common application in various classification problems where the feature training matrix has missingness. A widely used solution to this imputation problem is based on the lazy learning technique, $k$-nearest neighbor (kNN) approach. However, most of the previous work on missing data does not take into account the presence of the class label in the classification problem. Also, existing kNN imputation methods use variants of Minkowski distance as a measure of distance, which does not work well with heterogeneous data. In this paper, we propose a novel iterative kNN imputation technique based on class weighted grey distance between the missing datum and all the training data. Grey distance works well in heterogeneous data with missing instances. The distance is weighted by Mutual Information (MI) which is a measure of feature relevance between the features and the class label. This ensures that the imputation of the training data is directed towards improving classification performance. This class weighted grey kNN imputation algorithm demonstrates improved performance when compared to other kNN imputation algorithms, as well as standard imputation algorithms such as MICE and missForest, in imputation and classification problems. These problems are based on simulated scenarios and UCI datasets with various rates of missingness.

📄 PDF Abstract BibTeX arXiv:2002.10709

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral ClassificationImputation

Similar Papers 제목 키워드 기반

Evolving imputation strategies for missing data in classification problems with TPOT

2017-06-04 · Unai Garciarena, Roberto Santana, Alexander Mendiburu

Missing data has a ubiquitous presence in real-life applications of machine learning techniques. Imputation methods are algorithms conceived for restoring missing values in the data, based on other entries in the databas…

BIG-bench Machine LearningClassificationGeneral ClassificationImputation+1

Principal Component Analysis based frameworks for efficient missing data imputation algorithms

2022-05-30 · Thu Nguyen, Hoang Thien Ly, Michael Alexander Riegler, Pål Halvorsen 외

Missing data is a commonly occurring problem in practice. Many imputation methods have been developed to fill in the missing entries. However, not all of them can scale to high-dimensional data, especially the multiple i…

ClassificationDimensionality ReductionImputation

On the Relation between Prediction and Imputation Accuracy under Missing Covariates

2021-12-09 · Burim Ramosaj, Justus Tulowietzki, Markus Pauly

Missing covariates in regression or classification problems can prohibit the direct use of advanced tools for further analysis. Recent research has realized an increasing trend towards the usage of modern Machine Learnin…

BIG-bench Machine LearningImputationPredictionPrediction Intervals+3

Semi-supervised Learning with Missing Values Imputation

2021-06-03 · Buliao Huang, Yunhui Zhu, Muhammad Usman, Huanhuan Chen

Incomplete instances with various missing attributes in many real-world applications have brought challenges to the classification tasks. Missing values imputation methods are often employed to replace the missing values…

ClassificationDenoisingDensity EstimationImputation+1

Filling out the missing gaps: Time Series Imputation with Semi-Supervised Learning

2023-04-09 · Karan Aggarwal, Jaideep Srivastava

Missing data in time series is a challenging issue affecting time series analysis. Missing data occurs due to problems like data drops or sensor malfunctioning. Imputation methods are used to fill in these values, with q…

ImputationTime SeriesTime Series Analysis