paper-with-me

Papers

A Super-pixel-based Approach to the Stable Interpretation of Neural Networks

2024-12-19 · Shizhan Gong, Jingwei Zhang, Qi Dou, Farzan Farnia

Saliency maps are widely used in the computer vision community for interpreting neural network classifiers. However, due to the randomness of training samples and optimization algorithms, the resulting saliency maps suffer from a significant level of stochasticity, making it difficult for domain experts to capture the intrinsic factors that influence the neural network's decision. In this work, we propose a novel pixel partitioning strategy to boost the stability and generalizability of gradient-based saliency maps. Through both theoretical analysis and numerical experiments, we demonstrate that the grouping of pixels reduces the variance of the saliency map and improves the generalization behavior of the interpretation method. Furthermore, we propose a sensible grouping strategy based on super-pixels which cluster pixels into groups that align well with the semantic meaning of the images. We perform several numerical experiments on CIFAR-10 and ImageNet. Our empirical results suggest that the super-pixel-based interpretation maps consistently improve the stability and quality over the pixel-based saliency maps.

📄 PDF Abstract BibTeX arXiv:2412.14509

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Are machine learning interpretations reliable? A stability study on global interpretations

2025-05-21 · Luqin Gan, Tarek M. Zikry, Genevera I. Allen

As machine learning systems are increasingly used in high-stakes domains, there is a growing emphasis placed on making them interpretable to improve trust in these systems. In response, a range of interpretable machine l…

Interpretable Machine Learning

Ensemble Interpretation: A Unified Method for Interpretable Machine Learning

2023-12-11 · Chao Min, Guoyong Liao, Guoquan Wen, Yingjun Li 외

To address the issues of stability and fidelity in interpretable learning, a novel interpretable methodology, ensemble interpretation, is presented in this paper which integrates multi-perspective explanation of various …

feature selectionInterpretable Machine Learning

Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach

2024-12-04 · CVPR 2025 1 · Lingchen Sun, Rongyuan Wu, Zhiyuan Ma, Shuaizheng Liu 외

Diffusion prior-based methods have shown impressive results in real-world image super-resolution (SR). However, most existing methods entangle pixel-level and semantic-level SR objectives in the training process, struggl…

Image Super-ResolutionSuper-Resolution

SuperPatchMatch: an Algorithm for Robust Correspondences using Superpixel Patches

2019-03-17 · Rémi Giraud, Vinh-Thong Ta, Aurélie Bugeau, Pierrick Coupé 외

Superpixels have become very popular in many computer vision applications. Nevertheless, they remain underexploited since the superpixel decomposition may produce irregular and non stable segmentation results due to the …

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1

CheXseg: Combining Expert Annotations with DNN-generated Saliency Maps for X-ray Segmentation

2021-02-21 · Soham Gadgil, Mark Endo, Emily Wen, Andrew Y. Ng 외

Medical image segmentation models are typically supervised by expert annotations at the pixel-level, which can be expensive to acquire. In this work, we propose a method that combines the high quality of pixel-level expe…

Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentation+1