paper-with-me

홈 › Papers

P-TAME: Explain Any Image Classifier with Trained Perturbations

2025-01-29 · Mariano V. Ntrougkas, Vasileios Mezaris, Ioannis Patras

The adoption of Deep Neural Networks (DNNs) in critical fields where predictions need to be accompanied by justifications is hindered by their inherent black-box nature. In this paper, we introduce P-TAME (Perturbation-based Trainable Attention Mechanism for Explanations), a model-agnostic method for explaining DNN-based image classifiers. P-TAME employs an auxiliary image classifier to extract features from the input image, bypassing the need to tailor the explanation method to the internal architecture of the backbone classifier being explained. Unlike traditional perturbation-based methods, which have high computational requirements, P-TAME offers an efficient alternative by generating high-resolution explanations in a single forward pass during inference. We apply P-TAME to explain the decisions of VGG-16, ResNet-50, and ViT-B-16, three distinct and widely used image classifiers. Quantitative and qualitative results show that our method matches or outperforms previous explainability methods, including model-specific approaches. Code and trained models will be released upon acceptance.

📄 PDF Abstract BibTeX arXiv:2501.17813

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
VGG-16 설명 없음

Similar Papers 제목 키워드 기반

T-TAME: Trainable Attention Mechanism for Explaining Convolutional Networks and Vision Transformers

2024-03-07 · Mariano V. Ntrougkas, Nikolaos Gkalelis, Vasileios Mezaris

The development and adoption of Vision Transformers and other deep-learning architectures for image classification tasks has been rapid. However, the "black box" nature of neural networks is a barrier to adoption in appl…

Explanation Generationimage-classification

TAME: Attention Mechanism Based Feature Fusion for Generating Explanation Maps of Convolutional Neural Networks

2023-01-18 · Mariano Ntrougkas, Nikolaos Gkalelis, Vasileios Mezaris

The apparent ``black box'' nature of neural networks is a barrier to adoption in applications where explainability is essential. This paper presents TAME (Trainable Attention Mechanism for Explanations), a method for gen…

Towards Metamerism via Foveated Style Transfer

2017-05-29 · ICLR 2019 5 · Arturo Deza, Aditya Jonnalagadda, Miguel Eckstein

The problem of $\textit{visual metamerism}$ is defined as finding a family of perceptually indistinguishable, yet physically different images. In this paper, we propose our NeuroFovea metamer model, a foveated generative…

DecoderMetamerismStyle TransferTexture Synthesis

Explaining Classifiers using Adversarial Perturbations on the Perceptual Ball

2019-12-19 · CVPR 2021 1 · Andrew Elliott, Stephen Law, Chris Russell

We present a simple regularization of adversarial perturbations based upon the perceptual loss. While the resulting perturbations remain imperceptible to the human eye, they differ from existing adversarial perturbations…

counterfactual

TAME: Test-Time Adversarial Prompt Tuning via Mixture-of-Experts for Vision-Language Models

2026-05-17 · Xin Wang, Yixu Wang, Jiaming Zhang, Ruofan Wang 외 arxiv

Large-scale pre-trained Vision-Language models (VLMs), such as CLIP, exhibit strong zero-shot generalization, yet remain highly vulnerable to imperceptible adversarial perturbations, raising serious safety concerns for o…

Zero-shot GeneralizationAdversarial Robustness