paper-with-me

홈 › Papers

ShapeShifter: Robust Physical Adversarial Attack on Faster R-CNN Object Detector

2018-04-16 · Shang-Tse Chen, Cory Cornelius, Jason Martin, Duen Horng Chau

Given the ability to directly manipulate image pixels in the digital input space, an adversary can easily generate imperceptible perturbations to fool a Deep Neural Network (DNN) image classifier, as demonstrated in prior work. In this work, we propose ShapeShifter, an attack that tackles the more challenging problem of crafting physical adversarial perturbations to fool image-based object detectors like Faster R-CNN. Attacking an object detector is more difficult than attacking an image classifier, as it needs to mislead the classification results in multiple bounding boxes with different scales. Extending the digital attack to the physical world adds another layer of difficulty, because it requires the perturbation to be robust enough to survive real-world distortions due to different viewing distances and angles, lighting conditions, and camera limitations. We show that the Expectation over Transformation technique, which was originally proposed to enhance the robustness of adversarial perturbations in image classification, can be successfully adapted to the object detection setting. ShapeShifter can generate adversarially perturbed stop signs that are consistently mis-detected by Faster R-CNN as other objects, posing a potential threat to autonomous vehicles and other safety-critical computer vision systems.

📄 PDF Abstract BibTeX arXiv:1804.05810

Code (3)

shangtse/robust-physical-attack 공식 구현 tf
AishrithRao/robust-physical-attack tf
eetkim/physatt tf

Tasks

Adversarial AttackAutonomous VehiclesGeneral Classificationimage-classificationImage ClassificationObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIPool 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

Talk Proposal: Towards the Realistic Evaluation of Evasion Attacks using CARLA

2019-04-18 · Cory Cornelius, Shang-Tse Chen, Jason Martin, Duen Horng Chau

In this talk we describe our content-preserving attack on object detectors, ShapeShifter, and demonstrate how to evaluate this threat in realistic scenarios. We describe how we use CARLA, a realistic urban driving simula…

Physical Adversarial Examples for Object Detectors

2018-07-20 · Kevin Eykholt, Ivan Evtimov, Earlence Fernandes, Bo Li 외

Deep neural networks (DNNs) are vulnerable to adversarial examples-maliciously crafted inputs that cause DNNs to make incorrect predictions. Recent work has shown that these attacks generalize to the physical domain, to …

Objectobject-detectionObject Detection

Adversarial T-shirt! Evading Person Detectors in A Physical World

2019-10-18 · ECCV 2020 8 · Kaidi Xu, Gaoyuan Zhang, Sijia Liu, Quanfu Fan 외

It is known that deep neural networks (DNNs) are vulnerable to adversarial attacks. The so-called physical adversarial examples deceive DNN-based decisionmakers by attaching adversarial patches to real objects. However, …

Note on Attacking Object Detectors with Adversarial Stickers

2017-12-21 · Kevin Eykholt, Ivan Evtimov, Earlence Fernandes, Bo Li 외

Deep learning has proven to be a powerful tool for computer vision and has seen widespread adoption for numerous tasks. However, deep learning algorithms are known to be vulnerable to adversarial examples. These adversar…

Deep LearningObject

Unified Adversarial Patch for Cross-modal Attacks in the Physical World

2023-07-15 · ICCV 2023 1 · Xingxing Wei, Yao Huang, Yitong Sun, Jie Yu

Recently, physical adversarial attacks have been presented to evade DNNs-based object detectors. To ensure the security, many scenarios are simultaneously deployed with visible sensors and infrared sensors, leading to th…