paper-with-me

홈 › Papers

Pixab-CAM: Attend Pixel, not Channel

2021-09-29 · Jaeeun Jang, Seokjun Kim, Hyeoncheol Kim

To understand the internal behaviors of convolution neural networks (CNNs), many class activation mapping (CAM) based methods, which generate an explanation map by a linear combination of channels and corresponding weights, have been proposed. Previous CAM-based methods have tried to define a channel-wise weight that represents the importance of a channel for the target class. However, these methods have two common limitations. First, all pixels in the channel share a single scalar value. If the pixels are tied to a specific value, some of them are overestimated. Second, since the explanation map is the result of a linear combination of channels in the activation tensor, it is inevitably dependent on the activation tensor. To address these issues, we propose gradient-free Pixel-wise Ablation-CAM (Pixab-CAM), which utilizes pixel-wise weights rather than channel-wise weights to break the link between pixels in a channel. In addition, in order not to generate an explanation map dependent on the activation tensor, the explanation map is generated only with pixel-wise weights without linear combination with the activation tensor. In this paper, we also propose novel evaluation metrics to measure the quality of explanation maps using an adversarial attack. We demonstrate through experiments the qualitative and quantitative superiority of Pixab-CAM.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Attack

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

From Pixels to Objects: Cubic Visual Attention for Visual Question Answering

2022-06-04 · Jingkuan Song, Pengpeng Zeng, Lianli Gao, Heng Tao Shen

Recently, attention-based Visual Question Answering (VQA) has achieved great success by utilizing question to selectively target different visual areas that are related to the answer. Existing visual attention models are…

ObjectQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Channel Attention Is All You Need for Video Frame Interpolation

2020-04-03 · AAAI Conference on Artificial Intelligence 2020 4 · Myungsub Choi, Heewon Kim, Bohyung Han, Ning Xu 외

Prevailing video frame interpolation techniques rely heavily on optical flow estimation and require additional model complexity and computational cost; it is also susceptible to error propagation in challenging scenarios…

AllMotion EstimationOptical Flow EstimationVideo Frame Interpolation

Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsampling

2026-03-31 · Deepank Singh, Anurag Nihal, Vedhus Hoskere arxiv

Unsupervised segmentation approaches have increasingly leveraged foundation models (FM) to improve salient object discovery. However, these methods often falter in scenes with complex, multi-component morphologies, where…

Semantic Segmentation

AttentionBoost: Learning What to Attend by Boosting Fully Convolutional Networks

2019-08-06 · Gozde Nur Gunesli, Cenk Sokmensuer, Cigdem Gunduz-Demir

Dense prediction models are widely used for image segmentation. One important challenge is to sufficiently train these models to yield good generalizations for hard-to-learn pixels. A typical group of such hard-to-learn …

Image SegmentationSemantic Segmentation

A Revisit to the Decoder for Camouflaged Object Detection

2025-03-18 · Seung Woo Ko, Joopyo Hong, Suyoung Kim, Seungjai Bang 외

Camouflaged object detection (COD) aims to generate a fine-grained segmentation map of camouflaged objects hidden in their background. Due to the hidden nature of camouflaged objects, it is essential for the decoder to b…

Decoderobject-detectionObject DetectionSegmentation