Handling Missing Values in Local Post-hoc Explainability
Missing data are quite common in real scenarios when using Artificial Intelligence (AI) systems for decision-making with tabular data and effectively handling them poses a significant challenge for such systems. While some machine learning models used by AI systems can tackle this problem, the existing literature lacks post-hoc explainability approaches able to deal with predictors that encounter missing data. In this paper, we extend a widely used local model-agnostic post-hoc explanation approach that enables explainability in the presence of missing values by incorporating state-of-the-art imputation methods within the explanation process. Since our proposal returns explanations in the form of feature importance, the user will be aware also of the importance of a missing value in a given record for a particular prediction. Extensive experiments show the effectiveness of the proposed method with respect to some baseline solutions relying on traditional data imputation.
Code (1)
Tasks
Decision MakingFeature ImportanceImputationMissing ValuesSimilar Papers 제목 키워드 기반
Common Steps in Machine Learning Might Hinder The Explainability Aims in Medicine
Data pre-processing is a significant step in machine learning to improve the performance of the model and decreases the running time. This might include dealing with missing values, outliers detection and removing, data …
Data AugmentationDimensionality ReductionMissing ValuesIFGAN: Missing Value Imputation using Feature-specific Generative Adversarial Networks
Missing value imputation is a challenging and well-researched topic in data mining. In this paper, we propose IFGAN, a missing value imputation algorithm based on Feature-specific Generative Adversarial Networks (GAN). O…
ImputationMissing ValuesRefiDiff: Refinement-Aware Diffusion for Efficient Missing Data Imputation
Missing values in high-dimensional, mixed-type datasets pose significant challenges for data imputation, particularly under Missing Not At Random (MNAR) mechanisms. Existing methods struggle to integrate local and global…
DenoisingImputationMambaMissing ValuesExplainable Deep Modeling of Tabular Data using TableGraphNet
The vast majority of research on explainability focuses on post-explainability rather than explainable modeling. Namely, an explanation model is derived to explain a complex black box model built with the sole purpose of…
AttributeDirectly Handling Missing Data in Linear Discriminant Analysis for Enhancing Classification Accuracy and Interpretability
As the adoption of Artificial Intelligence (AI) models expands into critical real-world applications, ensuring the explainability of these models becomes paramount, particularly in sensitive fields such as medicine and f…
ClassificationImputationMissing Valuesparameter estimation+1