paper-with-me

Papers

Exploring the Interplay of Interpretability and Robustness in Deep Neural Networks: A Saliency-guided Approach

2024-05-10 · Amira Guesmi, Nishant Suresh Aswani, Muhammad Shafique

Adversarial attacks pose a significant challenge to deploying deep learning models in safety-critical applications. Maintaining model robustness while ensuring interpretability is vital for fostering trust and comprehension in these models. This study investigates the impact of Saliency-guided Training (SGT) on model robustness, a technique aimed at improving the clarity of saliency maps to deepen understanding of the model's decision-making process. Experiments were conducted on standard benchmark datasets using various deep learning architectures trained with and without SGT. Findings demonstrate that SGT enhances both model robustness and interpretability. Additionally, we propose a novel approach combining SGT with standard adversarial training to achieve even greater robustness while preserving saliency map quality. Our strategy is grounded in the assumption that preserving salient features crucial for correctly classifying adversarial examples enhances model robustness, while masking non-relevant features improves interpretability. Our technique yields significant gains, achieving a 35\% and 20\% improvement in robustness against PGD attack with noise magnitudes of $0.2$ and $0.02$ for the MNIST and CIFAR-10 datasets, respectively, while producing high-quality saliency maps.

📄 PDF Abstract BibTeX arXiv:2405.06278

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Improving Deep Learning Interpretability by Saliency Guided Training

2021-11-29 · NeurIPS 2021 12 · Aya Abdelsalam Ismail, Héctor Corrada Bravo, Soheil Feizi

Saliency methods have been widely used to highlight important input features in model predictions. Most existing methods use backpropagation on a modified gradient function to generate saliency maps. Thus, noisy gradient…

Deep LearningTime SeriesTime Series Analysis

Understanding Generalization, Robustness, and Interpretability in Low-Capacity Neural Networks

2025-07-22 · Yash Kumar arxiv

Although modern deep learning often relies on massive over-parameterized models, the fundamental interplay between capacity, sparsity, and robustness in low-capacity networks remains a vital area of study. We introduce a…

Binary Classification

Increasing Interpretability of Neural Networks By Approximating Human Visual Saliency

2024-10-21 · Aidan Boyd, Mohamed Trabelsi, Huseyin Uzunalioglu, Dan Kushnir

Understanding specifically where a model focuses on within an image is critical for human interpretability of the decision-making process. Deep learning-based solutions are prone to learning coincidental correlations in …

Active LearningDecision Making

Quantized and Interpretable Learning Scheme for Deep Neural Networks in Classification Task

2024-12-05 · Alireza Maleki, Mahsa Lavaei, Mohsen Bagheritabar, Salar Beigzad 외

Deep learning techniques have proven highly effective in image classification, but their deployment in resourceconstrained environments remains challenging due to high computational demands. Furthermore, their interpreta…

image-classificationImage ClassificationQuantization

SG-CLDFF: A Novel Framework for Automated White Blood Cell Classification and Segmentation

2025-10-20 · Mehdi Zekriyapanah Gashti, Mostafa Mohammadpour, Ghasem Farjamnia arxiv

Accurate segmentation and classification of white blood cells (WBCs) in microscopic images are essential for diagnosis and monitoring of many hematological disorders, yet remain challenging due to staining variability, c…