paper-with-me

홈 › Papers

Enhancing Deep Neural Network Saliency Visualizations with Gradual Extrapolation

2021-04-11 · Tomasz Szandala

In this paper, an enhancement technique for the class activation mapping methods such as gradient-weighted class activation maps or excitation backpropagation is proposed to present the visual explanations of decisions from convolutional neural network-based models. The proposed idea, called Gradual Extrapolation, can supplement any method that generates a heatmap picture by sharpening the output. Instead of producing a coarse localization map that highlights the important predictive regions in the image, the proposed method outputs the specific shape that most contributes to the model output. Thus, the proposed method improves the accuracy of saliency maps. The effect has been achieved by the gradual propagation of the crude map obtained in the deep layer through all preceding layers with respect to their activations. In validation tests conducted on a selected set of images, the faithfulness, interpretability, and applicability of the method are evaluated. The proposed technique significantly improves the localization detection of the neural networks attention at low additional computational costs. Furthermore, the proposed method is applicable to a variety deep neural network models. The code for the method can be found at https://github.com/szandala/gradual-extrapolation

📄 PDF Abstract BibTeX arXiv:2104.04945

Code (1)

szandala/gradual-extrapolation 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Heatmap 설명 없음

Similar Papers 제목 키워드 기반

Free-Lunch Saliency via Attention in Atari Agents

2019-08-07 · Dmitry Nikulin, Anastasia Ianina, Vladimir Aliev, Sergey Nikolenko

We propose a new approach to visualize saliency maps for deep neural network models and apply it to deep reinforcement learning agents trained on Atari environments. Our method adds an attention module that we call FLS (…

Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1

SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches

2026-06-16 · Wencan Zhang, Mario Michelessa, Xuejun Zhao, Brian Y. Lim arxiv

Saliency map visualizations explain image-based AI predictions by pointing to regions, but these are often unintuitive and semantically unclear, leaving an interpretability gap. We argue that AI explanations should be in…

An Iterative and Cooperative Top-Down and Bottom-Up Inference Network for Salient Object Detection

2019-06-01 · CVPR 2019 6 · Wenguan Wang, Jianbing Shen, Ming-Ming Cheng, Ling Shao

This paper presents a salient object detection method that integrates both top-down and bottom-up saliency inference in an iterative and cooperative manner. The top-down process is used for coarse-to-fine saliency estima…

object-detectionObject DetectionRGB Salient Object DetectionSaliency Prediction+1

What do different evaluation metrics tell us about saliency models?

2016-04-12 · Zoya Bylinskii, Tilke Judd, Aude Oliva, Antonio Torralba 외

How best to evaluate a saliency model's ability to predict where humans look in images is an open research question. The choice of evaluation metric depends on how saliency is defined and how the ground truth is represen…

A Theoretical Explanation for Perplexing Behaviors of Backpropagation-based Visualizations

2018-05-18 · ICML 2018 7 · Weili Nie, Yang Zhang, Ankit Patel

Backpropagation-based visualizations have been proposed to interpret convolutional neural networks (CNNs), however a theory is missing to justify their behaviors: Guided backpropagation (GBP) and deconvolutional network …