paper-with-me

홈 › Papers

Multi-objective Explanations of GNN Predictions

2021-11-29 · Yifei Liu, Chao Chen, Yazheng Liu, Xi Zhang, Sihong Xie

Graph Neural Network (GNN) has achieved state-of-the-art performance in various high-stake prediction tasks, but multiple layers of aggregations on graphs with irregular structures make GNN a less interpretable model. Prior methods use simpler subgraphs to simulate the full model, or counterfactuals to identify the causes of a prediction. The two families of approaches aim at two distinct objectives, "simulatability" and "counterfactual relevance", but it is not clear how the objectives can jointly influence the human understanding of an explanation. We design a user study to investigate such joint effects and use the findings to design a multi-objective optimization (MOO) algorithm to find Pareto optimal explanations that are well-balanced in simulatability and counterfactual. Since the target model can be of any GNN variants and may not be accessible due to privacy concerns, we design a search algorithm using zeroth-order information without accessing the architecture and parameters of the target model. Quantitative experiments on nine graphs from four applications demonstrate that the Pareto efficient explanations dominate single-objective baselines that use first-order continuous optimization or discrete combinatorial search. The explanations are further evaluated in robustness and sensitivity to show their capability of revealing convincing causes while being cautious about the possible confounders. The diverse dominating counterfactuals can certify the feasibility of algorithmic recourse, that can potentially promote algorithmic fairness where humans are participating in the decision-making using GNN.

📄 PDF Abstract BibTeX arXiv:2111.14651

Code (0)

등록된 구현이 없습니다.

Tasks

counterfactualDecision MakingFairnessGraph Neural Network

Methods 이 논문이 사용한 방법론

Counterfactuals 설명 없음

Similar Papers 제목 키워드 기반

Multi-Objective Counterfactual Explanations

2020-04-23 · Susanne Dandl, Christoph Molnar, Martin Binder, Bernd Bischl

Counterfactual explanations are one of the most popular methods to make predictions of black box machine learning models interpretable by providing explanations in the form of `what-if scenarios'. Most current approaches…

counterfactualDiversity

Faithful and Plausible Explanations of Medical Code Predictions

2021-04-16 · Zach Wood-Doughty, Isabel Cachola, Mark Dredze

Machine learning models that offer excellent predictive performance often lack the interpretability necessary to support integrated human machine decision-making. In clinical medicine and other high-risk settings, domain…

Decision Making

Features of Explainability: How users understand counterfactual and causal explanations for categorical and continuous features in XAI

2022-04-21 · Greta Warren, Mark T Keane, Ruth M J Byrne

Counterfactual explanations are increasingly used to address interpretability, recourse, and bias in AI decisions. However, we do not know how well counterfactual explanations help users to understand a systems decisions…

counterfactualExplainable Artificial Intelligence (XAI)

Semantic Explanations of Predictions

2018-05-27 · Freddy Lecue, Jiewen Wu

The main objective of explanations is to transmit knowledge to humans. This work proposes to construct informative explanations for predictions made from machine learning models. Motivated by the observations from social…

General Classification

TX-Gen: Multi-Objective Optimization for Sparse Counterfactual Explanations for Time-Series Classification

2024-09-14 · Qi Huang, Sofoklis Kitharidis, Thomas Bäck, Niki van Stein

In time-series classification, understanding model decisions is crucial for their application in high-stakes domains such as healthcare and finance. Counterfactual explanations, which provide insights by presenting alter…

counterfactualTime SeriesTime Series Classificationvalid