paper-with-me

Papers

Understanding Misclassifications by Attributes

2019-10-15 · Sadaf Gulshad, Zeynep Akata, Jan Hendrik Metzen, Arnold Smeulders

In this paper, we aim to understand and explain the decisions of deep neural networks by studying the behavior of predicted attributes when adversarial examples are introduced. We study the changes in attributes for clean as well as adversarial images in both standard and adversarially robust networks. We propose a metric to quantify the robustness of an adversarially robust network against adversarial attacks. In a standard network, attributes predicted for adversarial images are consistent with the wrong class, while attributes predicted for the clean images are consistent with the true class. In an adversarially robust network, the attributes predicted for adversarial images classified correctly are consistent with the true class. Finally, we show that the ability to robustify a network varies for different datasets. For the fine grained dataset, it is higher as compared to the coarse-grained dataset. Additionally, the ability to robustify a network increases with the increase in adversarial noise.

📄 PDF Abstract BibTeX arXiv:1910.07416

Code (1)

sadafgulshad1/Understaning-Misclassifications-by-Attributes pytorch

Similar Papers 제목 키워드 기반

Ensembling Uncertainty Measures to Improve Safety of Black-Box Classifiers

2023-08-23 · Tommaso Zoppi, Andrea Ceccarelli, Andrea Bondavalli

Machine Learning (ML) algorithms that perform classification may predict the wrong class, experiencing misclassifications. It is well-known that misclassifications may have cascading effects on the encompassing system, p…

Multi-class Classification

Spawrious: A Benchmark for Fine Control of Spurious Correlation Biases

2023-03-09 · Aengus Lynch, Gbètondji J-S Dovonon, Jean Kaddour, Ricardo Silva

The problem of spurious correlations (SCs) arises when a classifier relies on non-predictive features that happen to be correlated with the labels in the training data. For example, a classifier may misclassify dog breed…

Image Captioningimage-classificationImage Classification

Shallow-Deep Networks: Understanding and Mitigating Network Overthinking

2018-10-16 · Yigitcan Kaya, Sanghyun Hong, Tudor Dumitras

We characterize a prevalent weakness of deep neural networks (DNNs)---overthinking---which occurs when a DNN can reach correct predictions before its final layer. Overthinking is computationally wasteful, and it can also…

image-classificationImage ClassificationPrediction

Causal Explanations of Image Misclassifications

2020-06-28 · Yan Min, Miles Bennett

The causal explanation of image misclassifications is an understudied niche, which can potentially provide valuable insights in model interpretability and increase prediction accuracy. This study trains CIFAR-10 on six m…

Predictability and Comprehensibility in Post-Hoc XAI Methods: A User-Centered Analysis

2023-09-21 · Anahid Jalali, Bernhard Haslhofer, Simone Kriglstein, Andreas Rauber

Post-hoc explainability methods aim to clarify predictions of black-box machine learning models. However, it is still largely unclear how well users comprehend the provided explanations and whether these increase the use…

counterfactual