paper-with-me

홈 › Papers

A Framework for Evaluating Faithfulness in Explainable AI for Machine Anomalous Sound Detection Using Frequency-Band Perturbation

2026-01-26 · Alexander Buck, Georgina Cosma, Iain Phillips, Paul Conway, Patrick Baker arxiv

Explainable AI (XAI) is commonly applied to anomalous sound detection (ASD) models to identify which time-frequency regions of an audio signal contribute to an anomaly decision. However, most audio explanations rely on qualitative inspection of saliency maps, leaving open the question of whether these attributions accurately reflect the spectral cues the model uses. In this work, we introduce a new quantitative framework for evaluating XAI faithfulness in machine-sound analysis by directly linking attribution relevance to model behaviour through systematic frequency-band removal. This approach provides an objective measure of whether an XAI method for machine ASD correctly identifies frequency regions that influence an ASD model's predictions. By using four widely adopted methods, namely Integrated Gradients, Occlusion, Grad-CAM and SmoothGrad, we show that XAI techniques differ in reliability, with Occlusion demonstrating the strongest alignment with true model sensitivity and gradient-+based methods often failing to accurately capture spectral dependencies. The proposed framework offers a reproducible way to benchmark audio explanations and enables more trustworthy interpretation of spectrogram-based ASD systems.

📄 PDF Abstract BibTeX arXiv:2601.19017

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Automated Processing of eXplainable Artificial Intelligence Outputs in Deep Learning Models for Fault Diagnostics of Large Infrastructures

2025-03-19 · Giovanni Floreale, Piero Baraldi, Enrico Zio, Olga Fink

Deep Learning (DL) models processing images to recognize the health state of large infrastructure components can exhibit biases and rely on non-causal shortcuts. eXplainable Artificial Intelligence (XAI) can address thes…

Anomaly DetectionExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Semi-supervised Anomaly Detection+1

ConceptSMILE: Auditing the Trustworthiness of Concept-Based Explainable AI

2026-07-10 · Mohadeseh Mollapour, Koorosh Aslansefat, Zeinab Dehghani, Bhupesh Kumar Mishra 외 arxiv

Concept-based explainable artificial intelligence (AI) can make model reasoning more human-understandable, but concept-level outputs are not automatically trustworthy. We introduce ConceptSMILE, a model-agnostic perturba…

EvalAttAI: A Holistic Approach to Evaluating Attribution Maps in Robust and Non-Robust Models

2023-03-15 · Ian E. Nielsen, Ravi P. Ramachandran, Nidhal Bouaynaya, Hassan M. Fathallah-Shaykh 외

The expansion of explainable artificial intelligence as a field of research has generated numerous methods of visualizing and understanding the black box of a machine learning model. Attribution maps are generally used t…

Explainable artificial intelligence

Metamorphic Testing with the Rashomon Set: Explanation Faithfulness in Machine Learning

2026-06-04 · Helge Spieker, Jørn Eirik Betten, Arnaud Gotlieb arxiv

Multiple machine learning models can achieve near-equivalent predictive performance on the same task, yet provide divergent feature-based explanations. This is called the Rashomon effect of (explainable) machine learning…

Feature Importance

Counterfactual Evaluation for Explainable AI

2021-09-05 · Yingqiang Ge, Shuchang Liu, Zelong Li, Shuyuan Xu 외

While recent years have witnessed the emergence of various explainable methods in machine learning, to what degree the explanations really represent the reasoning process behind the model prediction -- namely, the faithf…

counterfactualCounterfactual Reasoning