paper-with-me

홈 › Papers

DALEX: explainers for complex predictive models

2018-06-23 · Przemyslaw Biecek

Predictive modeling is invaded by elastic, yet complex methods such as neural networks or ensembles (model stacking, boosting or bagging). Such methods are usually described by a large number of parameters or hyper parameters - a price that one needs to pay for elasticity. The very number of parameters makes models hard to understand. This paper describes a consistent collection of explainers for predictive models, a.k.a. black boxes. Each explainer is a technique for exploration of a black box model. Presented approaches are model-agnostic, what means that they extract useful information from any predictive method despite its internal structure. Each explainer is linked with a specific aspect of a model. Some are useful in decomposing predictions, some serve better in understanding performance, while others are useful in understanding importance and conditional responses of a particular variable. Every explainer presented in this paper works for a single model or for a collection of models. In the latter case, models can be compared against each other. Such comparison helps to find strengths and weaknesses of different approaches and gives additional possibilities for model validation. Presented explainers are implemented in the DALEX package for R. They are based on a uniform standardized grammar of model exploration which may be easily extended. The current implementation supports the most popular frameworks for classification and regression.

📄 PDF Abstract BibTeX arXiv:1806.08915

Code (1)

pbiecek/DALEX 공식 구현 tf

Similar Papers 제목 키워드 기반

Does Dataset Complexity Matters for Model Explainers?

2021-07-06 · José Ribeiro, Raíssa Silva, Lucas Cardoso, Ronnie Alves

Strategies based on Explainable Artificial Intelligence - XAI have emerged in computing to promote a better understanding of predictions made by black box models. Most XAI measures used today explain these types of model…

AttributeExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)model

dalex: Responsible Machine Learning with Interactive Explainability and Fairness in Python

2020-12-28 · Hubert Baniecki, Wojciech Kretowicz, Piotr Piatyszek, Jakub Wisniewski 외

The increasing amount of available data, computing power, and the constant pursuit for higher performance results in the growing complexity of predictive models. Their black-box nature leads to opaqueness debt phenomenon…

BIG-bench Machine LearningFairness

In-Context Explainers: Harnessing LLMs for Explaining Black Box Models

2023-10-09 · Nicholas Kroeger, Dan Ley, Satyapriya Krishna, Chirag Agarwal 외

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in complex tasks like machine translation, commonsense reasoning, and language understanding. One of the primary reasons for …

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)In-Context LearningMachine Translation

Analyzing Explainer Robustness via Probabilistic Lipschitzness of Prediction Functions

2022-06-24 · Zulqarnain Khan, Davin Hill, Aria Masoomi, Joshua Bone 외

Machine learning methods have significantly improved in their predictive capabilities, but at the same time they are becoming more complex and less transparent. As a result, explainers are often relied on to provide inte…

Prediction

Evaluating the Explainers: Black-Box Explainable Machine Learning for Student Success Prediction in MOOCs

2022-07-01 · Vinitra Swamy, Bahar Radmehr, Natasa Krco, Mirko Marras 외

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially rel…

BIG-bench Machine LearningFeature Importance