paper-with-me

홈 › Papers

SlowFormer: Universal Adversarial Patch for Attack on Compute and Energy Efficiency of Inference Efficient Vision Transformers

2023-10-04 · KL Navaneet, Soroush Abbasi Koohpayegani, Essam Sleiman, Hamed Pirsiavash

Recently, there has been a lot of progress in reducing the computation of deep models at inference time. These methods can reduce both the computational needs and power usage of deep models. Some of these approaches adaptively scale the compute based on the input instance. We show that such models can be vulnerable to a universal adversarial patch attack, where the attacker optimizes for a patch that when pasted on any image, can increase the compute and power consumption of the model. We run experiments with three different efficient vision transformer methods showing that in some cases, the attacker can increase the computation to the maximum possible level by simply pasting a patch that occupies only 8\% of the image area. We also show that a standard adversarial training defense method can reduce some of the attack's success. We believe adaptive efficient methods will be necessary for the future to lower the power usage of deep models, so we hope our paper encourages the community to study the robustness of these methods and develop better defense methods for the proposed attack.

📄 PDF Abstract BibTeX arXiv:2310.02544

Code (1)

UCDvision/SlowFormer 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Similar Papers 제목 키워드 기반

SlowFormer: Adversarial Attack on Compute and Energy Consumption of Efficient Vision Transformers

2024-01-01 · CVPR 2024 1 · K L Navaneet, Soroush Abbasi Koohpayegani, Essam Sleiman, Hamed Pirsiavash

Recently there has been a lot of progress in reducing the computation of deep models at inference time. These methods can reduce both the computational needs and power usage of deep models. Some of these approaches a…

Adversarial Attack

Meta Adversarial Training against Universal Patches

2021-01-27 · Jan Hendrik Metzen, Nicole Finnie, Robin Hutmacher

Recently demonstrated physical-world adversarial attacks have exposed vulnerabilities in perception systems that pose severe risks for safety-critical applications such as autonomous driving. These attacks place adversar…

Autonomous Drivingimage-classificationImage ClassificationMeta-Learning

Defending Person Detection Against Adversarial Patch Attack by using Universal Defensive Frame

2022-04-27 · Youngjoon Yu, Hong Joo Lee, Hakmin Lee, Yong Man Ro

Person detection has attracted great attention in the computer vision area and is an imperative element in human-centric computer vision. Although the predictive performances of person detection networks have been improv…

Autonomous DrivingHuman Detectionobject-detectionObject Detection

Physical Passive Patch Adversarial Attacks on Visual Odometry Systems

2022-07-11 · Yaniv Nemcovsky, Matan Jacoby, Alex M. Bronstein, Chaim Baskin

Deep neural networks are known to be susceptible to adversarial perturbations -- small perturbations that alter the output of the network and exist under strict norm limitations. While such perturbations are usually disc…

Autonomous NavigationDrone navigationVisual Odometry

TnT Attacks! Universal Naturalistic Adversarial Patches Against Deep Neural Network Systems

2021-11-19 · Bao Gia Doan, Minhui Xue, Shiqing Ma, Ehsan Abbasnejad 외

Deep neural networks are vulnerable to attacks from adversarial inputs and, more recently, Trojans to misguide or hijack the model's decision. We expose the existence of an intriguing class of spatially bounded, physical…