paper-with-me

Papers

Weighted Average Gradients for Feature Attribution

2025-05-06 · Kien Tran Duc Tuan, Tam Nguyen Trong, Son Nguyen Hoang, Khoat Than, Anh Nguyen Duc

In explainable AI, Integrated Gradients (IG) is a widely adopted technique for assessing the significance of feature attributes of the input on model outputs by evaluating contributions from a baseline input to the current input. The choice of the baseline input significantly influences the resulting explanation. While the traditional Expected Gradients (EG) method assumes baselines can be uniformly sampled and averaged with equal weights, this study argues that baselines should not be treated equivalently. We introduce Weighted Average Gradients (WG), a novel approach that unsupervisedly evaluates baseline suitability and incorporates a strategy for selecting effective baselines. Theoretical analysis demonstrates that WG satisfies essential explanation method criteria and offers greater stability than prior approaches. Experimental results further confirm that WG outperforms EG across diverse scenarios, achieving an improvement of 10-35\% on main metrics. Moreover, by evaluating baselines, our method can filter a subset of effective baselines for each input to calculate explanations, maintaining high accuracy while reducing computational cost. The code is available at: https://github.com/Tamnt240904/weighted_baseline.

📄 PDF Abstract BibTeX arXiv:2505.03201

Code (1)

tamnt240904/weighted_baseline 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Path-Weighted Integrated Gradients for Interpretable Dementia Classification

2025-09-22 · Firuz Kamalov, Mohmad Al Falasi, Fadi Thabtah arxiv

Integrated Gradients (IG) is a widely used attribution method in explainable artificial intelligence (XAI). In this paper, we introduce Path-Weighted Integrated Gradients (PWIG), a generalization of IG that incorporates …

AGOP as Explanation: From Feature Learning to Per-Sample Attribution in Image Classifiers

2026-05-12 · Raj Kiran Gupta Katakam arxiv

The Average Gradient Outer Product (AGOP) governs feature learning in neural networks: the Neural Feature Ansatz states that weight Gram matrices at each layer align with the corresponding AGOP matrices computed over the…

Path-Sampled Integrated Gradients

2026-04-15 · Firuz Kamalov, Fadi Thabtah, R. Sivaraj, Neda Abdelhamid arxiv

We introduce path-sampled integrated gradients (PS-IG), a framework that generalizes feature attribution by computing the expected value over baselines sampled along the linear interpolation path. We prove that PS-IG is …

Constructing sensible baselines for Integrated Gradients

2024-12-18 · Jai Bardhan, Cyrin Neeraj, Mihir Rawat, Subhadip Mitra

Machine learning methods have seen a meteoric rise in their applications in the scientific community. However, little effort has been put into understanding these "black box" models. We show how one can apply integrated …

AGOP-IxG: A Gradient Covariance Filter for Local Feature Attribution on Tabular Data, with a Controlled Benchmark

2026-05-15 · Raj Kiran Gupta Katakam arxiv

Automated machine learning pipelines increasingly produce models whose predictions must be explained to end users, auditors, and downstream decision systems. The most widely used feature attribution methods (SHAP, Integr…