paper-with-me

Papers

Scratch that! An Evolution-based Adversarial Attack against Neural Networks

2019-12-05 · Malhar Jere, Loris Rossi, Briland Hitaj, Gabriela Ciocarlie, Giacomo Boracchi, Farinaz Koushanfar

We study black-box adversarial attacks for image classifiers in a constrained threat model, where adversaries can only modify a small fraction of pixels in the form of scratches on an image. We show that it is possible for adversaries to generate localized \textit{adversarial scratches} that cover less than $5\%$ of the pixels in an image and achieve targeted success rates of $98.77\%$ and $97.20\%$ on ImageNet and CIFAR-10 trained ResNet-50 models, respectively. We demonstrate that our scratches are effective under diverse shapes, such as straight lines or parabolic B\a'ezier curves, with single or multiple colors. In an extreme condition, in which our scratches are a single color, we obtain a targeted attack success rate of $66\%$ on CIFAR-10 with an order of magnitude fewer queries than comparable attacks. We successfully launch our attack against Microsoft's Cognitive Services Image Captioning API and propose various mitigation strategies.

📄 PDF Abstract BibTeX arXiv:1912.02316

Code (1)

jaryp/pixleattack pytorch

Tasks

Adversarial AttackImage CaptioningImage Classification

Methods 이 논문이 사용한 방법론

RMSProp RMSProp is an unpublished adaptive learning rate optimizer proposed by Geoff Hinton. The motivation…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Average Pooling 설명 없음
Auxiliary Classifier Auxiliary Classifiers are type of architectural component that seek to improve the convergence of very deep networks. They are classifier heads we attach to layers before the…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Inception-v3 Module Inception-v3 Module is an image block used in the Inception-v3 architecture. This architecture is used on the coarsest (8 ×…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Evolving Assembly Code in an Adversarial Environment

2024-03-28 · Irina Maliukov, Gera Weiss, Oded Margalit, Achiya Elyasaf

In this work, we evolve Assembly code for the CodeGuru competition. The goal is to create a survivor -- an Assembly program that runs the longest in shared memory, by resisting attacks from adversary survivors and findin…

Language ModellingLarge Language Model

The Efficacy of SHIELD under Different Threat Models

2019-02-01 · Cory Cornelius, Nilaksh Das, Shang-Tse Chen, Li Chen 외

In this appraisal paper, we evaluate the efficacy of SHIELD, a compression-based defense framework for countering adversarial attacks on image classification models, which was published at KDD 2018. Here, we consider alt…

Adversarial Attackimage-classificationImage Classification

Adjust-free adversarial example generation in speech recognition using evolutionary multi-objective optimization under black-box condition

2020-12-21 · Shoma Ishida, Satoshi Ono

This paper proposes a black-box adversarial attack method to automatic speech recognition systems. Some studies have attempted to attack neural networks for speech recognition; however, these methods did not consider the…

Adversarial AttackAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognition+1

Finite Gaussian Neurons: Defending against adversarial attacks by making neural networks say "I don't know"

2023-06-13 · Felix Grezes

Since 2014, artificial neural networks have been known to be vulnerable to adversarial attacks, which can fool the network into producing wrong or nonsensical outputs by making humanly imperceptible alterations to inputs…

SafeReview: Defending LLM-based Review Systems Against Adversarial Hidden Prompts

2026-04-29 · Yuan Xin, Yixuan Weng, Minjun Zhu, Ying Ling 외 arxiv

As Large Language Models (LLMs) are increasingly integrated into academic peer review, their vulnerability to adversarial hidden prompts, i.e., adversarial instructions embedded in submissions to manipulate outcomes, pos…