paper-with-me

홈 › Papers

Revisiting Model's Uncertainty and Confidences for Adversarial Example Detection

2021-03-09 · Ahmed Aldahdooh, Wassim Hamidouche, Olivier Déforges

Security-sensitive applications that rely on Deep Neural Networks (DNNs) are vulnerable to small perturbations that are crafted to generate Adversarial Examples(AEs). The AEs are imperceptible to humans and cause DNN to misclassify them. Many defense and detection techniques have been proposed. Model's confidences and Dropout, as a popular way to estimate the model's uncertainty, have been used for AE detection but they showed limited success against black- and gray-box attacks. Moreover, the state-of-the-art detection techniques have been designed for specific attacks or broken by others, need knowledge about the attacks, are not consistent, increase model parameters overhead, are time-consuming, or have latency in inference time. To trade off these factors, we revisit the model's uncertainty and confidences and propose a novel unsupervised ensemble AE detection mechanism that 1) uses the uncertainty method called SelectiveNet, 2) processes model layers outputs, i.e.feature maps, to generate new confidence probabilities. The detection method is called Selective and Feature based Adversarial Detection (SFAD). Experimental results show that the proposed approach achieves better performance against black- and gray-box attacks than the state-of-the-art methods and achieves comparable performance against white-box attacks. Moreover, results show that SFAD is fully robust against High Confidence Attacks (HCAs) for MNIST and partially robust for CIFAR10 datasets.

📄 PDF Abstract BibTeX arXiv:2103.05354

Code (1)

aldahdooh/SFAD 공식 구현

Tasks

Multi-Task LearningTransfer Learning

Methods 이 논문이 사용한 방법론

AE An autoencoder is a type of artificial neural network used to learn efficient data codings in an unsupervised manner. The aim of an autoencoder is to learn a representation…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Revisiting One-vs-All Classifiers for Predictive Uncertainty and Out-of-Distribution Detection in Neural Networks

2020-07-10 · Shreyas Padhy, Zachary Nado, Jie Ren, Jeremiah Liu 외

Accurate estimation of predictive uncertainty in modern neural networks is critical to achieve well calibrated predictions and detect out-of-distribution (OOD) inputs. The most promising approaches have been predominantl…

Allimage-classificationImage ClassificationOut-of-Distribution Detection+1

Uncertainty Distillation: Teaching Language Models to Express Semantic Confidence

2025-03-18 · Sophia Hager, David Mueller, Kevin Duh, Nicholas Andrews

As large language models (LLMs) are increasingly used for factual question-answering, it becomes more important for LLMs to have the capability to communicate the likelihood that their answer is correct. For these verbal…

Question AnsweringUncertainty Quantification

Toward Adversarial Robustness by Diversity in an Ensemble of Specialized Deep Neural Networks

2020-05-17 · Mahdieh Abbasi, Arezoo Rajabi, Christian Gagne, Rakesh B. Bobba

We aim at demonstrating the influence of diversity in the ensemble of CNNs on the detection of black-box adversarial instances and hardening the generation of white-box adversarial attacks. To this end, we propose an ens…

Adversarial RobustnessDiversity

ADDMU: Detection of Far-Boundary Adversarial Examples with Data and Model Uncertainty Estimation

2022-10-22 · Fan Yin, Yao Li, Cho-Jui Hsieh, Kai-Wei Chang

Adversarial Examples Detection (AED) is a crucial defense technique against adversarial attacks and has drawn increasing attention from the Natural Language Processing (NLP) community. Despite the surge of new AED method…

Understanding Measures of Uncertainty for Adversarial Example Detection

2018-03-22 · Lewis Smith, Yarin Gal

Measuring uncertainty is a promising technique for detecting adversarial examples, crafted inputs on which the model predicts an incorrect class with high confidence. But many measures of uncertainty exist, including pre…

General Classification