On the Performance of Imputation Techniques for Missing Values on Healthcare Datasets
Missing values or data is one popular characteristic of real-world datasets, especially healthcare data. This could be frustrating when using machine learning algorithms on such datasets, simply because most machine learning models perform poorly in the presence of missing values. The aim of this study is to compare the performance of seven imputation techniques, namely Mean imputation, Median Imputation, Last Observation carried Forward (LOCF) imputation, K-Nearest Neighbor (KNN) imputation, Interpolation imputation, Missforest imputation, and Multiple imputation by Chained Equations (MICE), on three healthcare datasets. Some percentage of missing values - 10\%, 15\%, 20\% and 25\% - were introduced into the dataset, and the imputation techniques were employed to impute these missing values. The comparison of their performance was evaluated by using root mean squared error (RMSE) and mean absolute error (MAE). The results show that Missforest imputation performs the best followed by MICE imputation. Additionally, we try to determine whether it is better to perform feature selection before imputation or vice versa by using the following metrics - the recall, precision, f1-score and accuracy. Due to the fact that there are few literature on this and some debate on the subject among researchers, we hope that the results from this experiment will encourage data scientists and researchers to perform imputation first before feature selection when dealing with data containing missing values.
Code (0)
등록된 구현이 없습니다.
Tasks
feature selectionImputationMissing ValuesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Handling missing values in healthcare data: A systematic review of deep learning-based imputation techniques
Objective: The proper handling of missing values is critical to delivering reliable estimates and decisions, especially in high-stakes fields such as clinical research. The increasing diversity and complexity of data hav…
ArticlesFairnessImputationMissing ValuesImputeINR: Time Series Imputation via Implicit Neural Representations for Disease Diagnosis with Missing Data
Healthcare data frequently contain a substantial proportion of missing values, necessitating effective time series imputation to support downstream disease diagnosis tasks. However, existing imputation methods focus on d…
ImputationMissing ValuesTime SeriesA Hamiltonian Monte Carlo Model for Imputation and Augmentation of Healthcare Data
Missing values exist in nearly all clinical studies because data for a variable or question are not collected or not available. Inadequate handling of missing values can lead to biased results and loss of statistical pow…
Bayesian InferenceImputationMissing ValuesMissing data imputation for noisy time-series data and applications in healthcare
Healthcare time series data is vital for monitoring patient activity but often contains noise and missing values due to various reasons such as sensor errors or data interruptions. Imputation, i.e., filling in the missin…
Deep LearningDenoisingImputationMissing Values+1RDIS: Random Drop Imputation with Self-Training for Incomplete Time Series Data
Time-series data with missing values are commonly encountered in many fields, such as healthcare, meteorology, and robotics. The imputation aims to fill the missing values with valid values. Most imputation methods train…
ImputationMissing ValuesTime SeriesTime Series Analysis+1