Model Interpretation and Explainability: Towards Creating Transparency in Prediction Models
Explainable AI (XAI) has a counterpart in analytical modeling which we refer to as model explainability. We tackle the issue of model explainability in the context of prediction models. We analyze a dataset of loans from a credit card company and apply three stages: execute and compare four different prediction methods, apply the best known explainability techniques in the current literature to the model training sets to identify feature importance (FI) (static case), and finally to cross-check whether the FI set holds up under what if prediction scenarios for continuous and categorical variables (dynamic case). We found inconsistency in FI identification between the static and dynamic cases. We summarize the state of the art in model explainability and suggest further research to advance the field.
Code (0)
등록된 구현이 없습니다.
Tasks
Feature ImportancePredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Explainable AI for clinical risk prediction: a survey of concepts, methods, and modalities
Recent advancements in AI applications to healthcare have shown incredible promise in surpassing human performance in diagnosis and disease prognosis. With the increasing complexity of AI models, however, concerns regard…
Decision MakingExplainable ModelsFairnessPrediction+1Towards Comparative Physical Interpretation of Spatial Variability Aware Neural Networks: A Summary of Results
Given Spatial Variability Aware Neural Networks (SVANNs), the goal is to investigate mathematical (or computational) models for comparative physical interpretation towards their transparency (e.g., simulatibility, decomp…
Component Based Quantum Machine Learning Explainability
Explainable ML algorithms are designed to provide transparency and insight into their decision-making process. Explaining how ML models come to their prediction is critical in fields such as healthcare and finance, as it…
Quantum Machine LearningNeuro-Symbolic AI: Explainability, Challenges, and Future Trends
Explainability is an essential reason limiting the application of neural networks in many vital fields. Although neuro-symbolic AI hopes to enhance the overall explainability by leveraging the transparency of symbolic le…
PredictionComposers' Evaluations of an AI Music Tool: Insights for Human-Centred Design
We present a study that explores the role of user-centred design in developing Generative AI (GenAI) tools for music composition. Through semi-structured interviews with professional composers, we gathered insights on a …