paper-with-me

Papers

Robustness of Visual Explanations to Common Data Augmentation

2023-04-18 · Lenka Tětková, Lars Kai Hansen

As the use of deep neural networks continues to grow, understanding their behaviour has become more crucial than ever. Post-hoc explainability methods are a potential solution, but their reliability is being called into question. Our research investigates the response of post-hoc visual explanations to naturally occurring transformations, often referred to as augmentations. We anticipate explanations to be invariant under certain transformations, such as changes to the colour map while responding in an equivariant manner to transformations like translation, object scaling, and rotation. We have found remarkable differences in robustness depending on the type of transformation, with some explainability methods (such as LRP composites and Guided Backprop) being more stable than others. We also explore the role of training with data augmentation. We provide evidence that explanations are typically less robust to augmentation than classification performance, regardless of whether data augmentation is used in training or not.

📄 PDF Abstract BibTeX arXiv:2304.08984

Code (1)

lenkatetkova/robustness-of-explanations 공식 구현 pytorch

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Fourier-basis Functions to Bridge Augmentation Gap: Rethinking Frequency Augmentation in Image Classification

2024-03-04 · CVPR 2024 1 · Puru Vaish, Shunxin Wang, Nicola Strisciuglio

Computer vision models normally witness degraded performance when deployed in real-world scenarios, due to unexpected changes in inputs that were not accounted for during training. Data augmentation is commonly used to a…

Data Augmentationimage-classificationImage Classification

An evaluation of quality and robustness of smoothed explanations

2021-09-29 · Ahmad Ajalloeian, Seyed-Mohsen Moosavi-Dezfooli, Michalis Vlachos, Pascal Frossard

Explanation methods play a crucial role in helping to understand the decisions of deep neural networks (DNNs) to develop trust that is critical for the adoption of predictive models. However, explanation methods are easi…

LLM-Based Visual Explanation Evaluation Framework for Assessing the Explainability of Facial Skin Disease Classification Models

2026-06-15 · Gyuyeon Na arxiv

This study proposes a domain-specific LLM-based Visual Explanation Evaluation Framework for assessing Grad-CAM explanations in facial skin disease diagnosis models. While previous studies have primarily focused on improv…

Clinical KnowledgePrompt EngineeringData Augmentation

NLKI: A lightweight Natural Language Knowledge Integration Framework for Improving Small VLMs in Commonsense VQA Tasks

2025-08-27 · Aritra Dutta, Swapnanil Mukherjee, Deepanway Ghosal, Somak Aditya arxiv

Commonsense visual-question answering often hinges on knowledge that is missing from the image or the question. Small vision-language models (sVLMs) such as ViLT, VisualBERT and FLAVA therefore lag behind their larger ge…

Question Answering

WSAM: Visual Explanations from Style Augmentation as Adversarial Attacker and Their Influence in Image Classification

2023-08-29 · Felipe Moreno-Vera, Edgar Medina, Jorge Poco

Currently, style augmentation is capturing attention due to convolutional neural networks (CNN) being strongly biased toward recognizing textures rather than shapes. Most existing styling methods either perform a low-fid…

image-classificationImage ClassificationStyle Transfer