paper-with-me

홈 › Papers

On the Robustness of Explanations of Deep Neural Network Models: A Survey

2022-11-09 · Amlan Jyoti, Karthik Balaji Ganesh, Manoj Gayala, Nandita Lakshmi Tunuguntla, Sandesh Kamath, Vineeth N Balasubramanian

Explainability has been widely stated as a cornerstone of the responsible and trustworthy use of machine learning models. With the ubiquitous use of Deep Neural Network (DNN) models expanding to risk-sensitive and safety-critical domains, many methods have been proposed to explain the decisions of these models. Recent years have also seen concerted efforts that have shown how such explanations can be distorted (attacked) by minor input perturbations. While there have been many surveys that review explainability methods themselves, there has been no effort hitherto to assimilate the different methods and metrics proposed to study the robustness of explanations of DNN models. In this work, we present a comprehensive survey of methods that study, understand, attack, and defend explanations of DNN models. We also present a detailed review of different metrics used to evaluate explanation methods, as well as describe attributional attack and defense methods. We conclude with lessons and take-aways for the community towards ensuring robust explanations of DNN model predictions.

📄 PDF Abstract BibTeX arXiv:2211.04780

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Survey on the Robustness of Feature Importance and Counterfactual Explanations

2021-10-30 · Saumitra Mishra, Sanghamitra Dutta, Jason Long, Daniele Magazzeni

There exist several methods that aim to address the crucial task of understanding the behaviour of AI/ML models. Arguably, the most popular among them are local explanations that focus on investigating model behaviour fo…

counterfactualFeature ImportanceSurvey

Robust Counterfactual Explanations in Machine Learning: A Survey

2024-02-02 · Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni

Counterfactual explanations (CEs) are advocated as being ideally suited to providing algorithmic recourse for subjects affected by the predictions of machine learning models. While CEs can be beneficial to affected indiv…

counterfactualSurvey

On the computation of counterfactual explanations -- A survey

2019-11-15 · André Artelt, Barbara Hammer

Due to the increasing use of machine learning in practice it becomes more and more important to be able to explain the prediction and behavior of machine learning models. An instance of explanations are counterfactual ex…

BIG-bench Machine LearningcounterfactualSurvey

Concerning Uncertainty -- A Systematic Survey of Uncertainty-Aware XAI

2026-03-27 · Helena Löfström, Tuwe Löfström, Anders Hjort, Fatima Rabia Yapicioglu arxiv

This paper surveys uncertainty-aware explainable artificial intelligence (UAXAI), examining how uncertainty is incorporated into explanatory pipelines and how such methods are evaluated. Across the literature, three recu…

A Comprehensive Survey on Self-Interpretable Neural Networks

2025-01-26 · Yang Ji, Ying Sun, Yuting Zhang, Zhigaoyuan Wang 외

Neural networks have achieved remarkable success across various fields. However, the lack of interpretability limits their practical use, particularly in critical decision-making scenarios. Post-hoc interpretability, whi…

Deep Reinforcement LearningSurvey