Enhancing Interpretability for Vision Models via Shapley Value Optimization
Deep neural networks have demonstrated remarkable performance across various domains, yet their decision-making processes remain opaque. Although many explanation methods are dedicated to bringing the obscurity of DNNs to light, they exhibit significant limitations: post-hoc explanation methods often struggle to faithfully reflect model behaviors, while self-explaining neural networks sacrifice performance and compatibility due to their specialized architectural designs. To address these challenges, we propose a novel self-explaining framework that integrates Shapley value estimation as an auxiliary task during training, which achieves two key advancements: 1) a fair allocation of the model prediction scores to image patches, ensuring explanations inherently align with the model's decision logic, and 2) enhanced interpretability with minor structural modifications, preserving model performance and compatibility. Extensive experiments on multiple benchmarks demonstrate that our method achieves state-of-the-art interpretability.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Feature Inference Attack on Shapley Values
As a solution concept in cooperative game theory, Shapley value is highly recognized in model interpretability studies and widely adopted by the leading Machine Learning as a Service (MLaaS) providers, such as Google, Mi…
Inference AttackPrivacy PreservingShapley-Value-Based Graph Sparsification for GNN Inference
Graph sparsification is a key technique for improving inference efficiency in Graph Neural Networks by removing edges with minimal impact on predictions. GNN explainability methods generate local importance scores, which…
SHAQ: Incorporating Shapley Value Theory into Multi-Agent Q-Learning
Value factorisation is a useful technique for multi-agent reinforcement learning (MARL) in global reward game, however its underlying mechanism is not yet fully understood. This paper studies a theoretical framework for …
FairnessMulti-agent Reinforcement LearningQ-LearningSMAC+1Game-theoretic Counterfactual Explanation for Graph Neural Networks
Graph Neural Networks (GNNs) have been a powerful tool for node classification tasks in complex networks. However, their decision-making processes remain a black-box to users, making it challenging to understand the reas…
counterfactualCounterfactual ExplanationDecision MakingNode ClassificationA $k$-additive Choquet integral-based approach to approximate the SHAP values for local interpretability in machine learning
Besides accuracy, recent studies on machine learning models have been addressing the question on how the obtained results can be interpreted. Indeed, while complex machine learning models are able to provide very good re…