DALEX: explainers for complex predictive models
Predictive modeling is invaded by elastic, yet complex methods such as neural networks or ensembles (model stacking, boosting or bagging). Such methods are usually described by a large number of parameters or hyper parameters - a price that one needs to pay for elasticity. The very number of parameters makes models hard to understand. This paper describes a consistent collection of explainers for predictive models, a.k.a. black boxes. Each explainer is a technique for exploration of a black box model. Presented approaches are model-agnostic, what means that they extract useful information from any predictive method despite its internal structure. Each explainer is linked with a specific aspect of a model. Some are useful in decomposing predictions, some serve better in understanding performance, while others are useful in understanding importance and conditional responses of a particular variable. Every explainer presented in this paper works for a single model or for a collection of models. In the latter case, models can be compared against each other. Such comparison helps to find strengths and weaknesses of different approaches and gives additional possibilities for model validation. Presented explainers are implemented in the DALEX package for R. They are based on a uniform standardized grammar of model exploration which may be easily extended. The current implementation supports the most popular frameworks for classification and regression.
Code (1)
Similar Papers 제목 키워드 기반
Does Dataset Complexity Matters for Model Explainers?
Strategies based on Explainable Artificial Intelligence - XAI have emerged in computing to promote a better understanding of predictions made by black box models. Most XAI measures used today explain these types of model…
AttributeExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)modeldalex: Responsible Machine Learning with Interactive Explainability and Fairness in Python
The increasing amount of available data, computing power, and the constant pursuit for higher performance results in the growing complexity of predictive models. Their black-box nature leads to opaqueness debt phenomenon…
BIG-bench Machine LearningFairnessIn-Context Explainers: Harnessing LLMs for Explaining Black Box Models
Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in complex tasks like machine translation, commonsense reasoning, and language understanding. One of the primary reasons for …
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)In-Context LearningMachine TranslationAnalyzing Explainer Robustness via Probabilistic Lipschitzness of Prediction Functions
Machine learning methods have significantly improved in their predictive capabilities, but at the same time they are becoming more complex and less transparent. As a result, explainers are often relied on to provide inte…
PredictionEvaluating the Explainers: Black-Box Explainable Machine Learning for Student Success Prediction in MOOCs
Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially rel…
BIG-bench Machine LearningFeature Importance