paper-with-me

홈 › Papers

A Survey on the Robustness of Feature Importance and Counterfactual Explanations

2021-10-30 · Saumitra Mishra, Sanghamitra Dutta, Jason Long, Daniele Magazzeni

There exist several methods that aim to address the crucial task of understanding the behaviour of AI/ML models. Arguably, the most popular among them are local explanations that focus on investigating model behaviour for individual instances. Several methods have been proposed for local analysis, but relatively lesser effort has gone into understanding if the explanations are robust and accurately reflect the behaviour of underlying models. In this work, we present a survey of the works that analysed the robustness of two classes of local explanations (feature importance and counterfactual explanations) that are popularly used in analysing AI/ML models in finance. The survey aims to unify existing definitions of robustness, introduces a taxonomy to classify different robustness approaches, and discusses some interesting results. Finally, the survey introduces some pointers about extending current robustness analysis approaches so as to identify reliable explainability methods.

📄 PDF Abstract BibTeX arXiv:2111.00358

Code (0)

등록된 구현이 없습니다.

Tasks

counterfactualFeature ImportanceSurvey

Similar Papers 제목 키워드 기반

Robust Counterfactual Explanations in Machine Learning: A Survey

2024-02-02 · Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni

Counterfactual explanations (CEs) are advocated as being ideally suited to providing algorithmic recourse for subjects affected by the predictions of machine learning models. While CEs can be beneficial to affected indiv…

counterfactualSurvey

Explaining Data-Driven Decisions made by AI Systems: The Counterfactual Approach

2020-01-21 · Carlos Fernández-Loría, Foster Provost, Xintian Han

We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives…

counterfactualFeature Importance

Don't Explain Noise: Robust Counterfactuals for Randomized Ensembles

2022-05-27 · Alexandre Forel, Axel Parmentier, Thibaut Vidal

Counterfactual explanations describe how to modify a feature vector in order to flip the outcome of a trained classifier. Obtaining robust counterfactual explanations is essential to provide valid algorithmic recourse an…

counterfactualvalid

Enhancing Counterfactual Image Generation Using Mahalanobis Distance with Distribution Preferences in Feature Space

2024-05-31 · Yukai Zhang, Ao Xu, Zihao Li, Tieru Wu

In the realm of Artificial Intelligence (AI), the importance of Explainable Artificial Intelligence (XAI) is increasingly recognized, particularly as AI models become more integral to our lives. One notable single-instan…

counterfactualCounterfactual ExplanationExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)+4

TriShGAN: Enhancing Sparsity and Robustness in Multivariate Time Series Counterfactuals Explanation

2025-11-09 · Hongnan Ma, Yiwei Shi, Guanxiong Sun, Mengyue Yang 외 arxiv

In decision-making processes, stakeholders often rely on counterfactual explanations, which provide suggestions about what should be changed in the queried instance to alter the outcome of an AI system. However, generati…

Metric Learning