paper-with-me

Papers

Iterative missing value imputation based on feature importance

2023-11-14 · Cong Guo, Chun Liu, Wei Yang

Many datasets suffer from missing values due to various reasons,which not only increases the processing difficulty of related tasks but also reduces the accuracy of classification. To address this problem, the mainstream approach is to use missing value imputation to complete the dataset. Existing imputation methods estimate the missing parts based on the observed values in the original feature space, and they treat all features as equally important during data completion, while in fact different features have different importance. Therefore, we have designed an imputation method that considers feature importance. This algorithm iteratively performs matrix completion and feature importance learning, and specifically, matrix completion is based on a filling loss that incorporates feature importance. Our experimental analysis involves three types of datasets: synthetic datasets with different noisy features and missing values, real-world datasets with artificially generated missing values, and real-world datasets originally containing missing values. The results on these datasets consistently show that the proposed method outperforms the existing five imputation algorithms.To the best of our knowledge, this is the first work that considers feature importance in the imputation model.

📄 PDF Abstract BibTeX arXiv:2311.08005

Code (0)

등록된 구현이 없습니다.

Tasks

Feature ImportanceImputationMatrix CompletionMissing Values

Similar Papers 제목 키워드 기반

A novel feature selection framework for incomplete data

2023-12-07 · Cong Guo

Feature selection on incomplete datasets is an exceptionally challenging task. Existing methods address this challenge by first employing imputation methods to complete the incomplete data and then conducting feature sel…

Feature Importancefeature selectionImputationMissing Values

Optimized Linear Imputation

2015-11-17 · Yehezkel S. Resheff, Daphna Weinshall

Often in real-world datasets, especially in high dimensional data, some feature values are missing. Since most data analysis and statistical methods do not handle gracefully missing values, the first step in the analysis…

ImputationMissing Valuesregression

Explainability of Machine Learning Models under Missing Data

2024-06-29 · Tuan L. Vo, Thu Nguyen, Luis M. Lopez-Ramos, Hugo L. Hammer 외

Missing data is a prevalent issue that can significantly impair model performance and explainability. This paper briefly summarizes the development of the field of missing data with respect to Explainable Artificial Inte…

Explainable artificial intelligenceFeature ImportanceImputationMissing Values

Handling Missing Data in Downstream Tasks With Distribution-Preserving Guarantees

2025-01-23 · Rahul Bordoloi, Clémence Réda, Saptarshi Bej, Olaf Wolkenhauer

Missing feature values are a significant hurdle for downstream machine-learning tasks such as classification. However, imputation methods for classification might be time-consuming for high-dimensional data, and offer fe…

Drug DiscoveryHandwritten Digit RecognitionImputationMissing Values

Imputing missing values with unsupervised random trees

2019-11-15 · David Cortes

This work proposes a non-iterative strategy for missing value imputations which is guided by similarity between observations, but instead of explicitly determining distances or nearest neighbors, it assigns observations …

ImputationMissing Valuesregression