Saliency strikes back: How filtering out high frequencies improves white-box explanations
Attribution methods correspond to a class of explainability methods (XAI) that aim to assess how individual inputs contribute to a model's decision-making process. We have identified a significant limitation in one type of attribution methods, known as ``white-box" methods. Although highly efficient, as we will show, these methods rely on a gradient signal that is often contaminated by high-frequency artifacts. To overcome this limitation, we introduce a new approach called "FORGrad". This simple method effectively filters out these high-frequency artifacts using optimal cut-off frequencies tailored to the unique characteristics of each model architecture. Our findings show that FORGrad consistently enhances the performance of already existing white-box methods, enabling them to compete effectively with more accurate yet computationally demanding "black-box" methods. We anticipate that our research will foster broader adoption of simpler and more efficient white-box methods for explainability, offering a better balance between faithfulness and computational efficiency.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyDecision MakingSimilar Papers 제목 키워드 기반
Multi-layered Cepstrum for Instantaneous Frequency Estimation
We propose the multi-layered cepstrum (MLC) method to estimate multiple fundamental frequencies (MF0) of a signal under challenging contamination such as high-pass filter noise. Taking the operation of cepstrum (i.e., Fo…
Multiband SAS Imagery
Advances in unmanned synthetic aperture sonar (SAS) imaging platforms allow for the simultaneous collection of multiband SAS imagery. The imagery is collected over several octaves and the phenomenology's interactions wit…
SGDViT: Saliency-Guided Dynamic Vision Transformer for UAV Tracking
Vision-based object tracking has boosted extensive autonomous applications for unmanned aerial vehicles (UAVs). However, the dynamic changes in flight maneuver and viewpoint encountered in UAV tracking pose significant d…
Object TrackingxAI-CycleGAN, a Cycle-Consistent Generative Assistive Network
In the domain of unsupervised image-to-image transformation using generative transformative models, CycleGAN has become the architecture of choice. One of the primary downsides of this architecture is its relatively slow…
counterfactualExplainable Artificial Intelligence (XAI)How spatial frequencies and color drive object search in real-world scenes: A new eye-movement corpus
When studying how people search for objects in scenes, the inhomogeneity of the visual field is often ignored. Due to physiological limitations peripheral vision is blurred and mainly uses coarse-grained information (i.e…
ObjectObject Localization