paper-with-me

홈 › Papers

Reproducibility Study on Adversarial Attacks Against Robust Transformer Trackers

2024-06-03 · Fatemeh Nourilenjan Nokabadi, Jean-François Lalonde, Christian Gagné

New transformer networks have been integrated into object tracking pipelines and have demonstrated strong performance on the latest benchmarks. This paper focuses on understanding how transformer trackers behave under adversarial attacks and how different attacks perform on tracking datasets as their parameters change. We conducted a series of experiments to evaluate the effectiveness of existing adversarial attacks on object trackers with transformer and non-transformer backbones. We experimented on 7 different trackers, including 3 that are transformer-based, and 4 which leverage other architectures. These trackers are tested against 4 recent attack methods to assess their performance and robustness on VOT2022ST, UAV123 and GOT10k datasets. Our empirical study focuses on evaluating adversarial robustness of object trackers based on bounding box versus binary mask predictions, and attack methods at different levels of perturbations. Interestingly, our study found that altering the perturbation level may not significantly affect the overall object tracking results after the attack. Similarly, the sparsity and imperceptibility of the attack perturbations may remain stable against perturbation level shifts. By applying a specific attack on all transformer trackers, we show that new transformer trackers having a stronger cross-attention modeling achieve a greater adversarial robustness on tracking datasets, such as VOT2022ST and GOT10k. Our results also indicate the necessity for new attack methods to effectively tackle the latest types of transformer trackers. The codes necessary to reproduce this study are available at https://github.com/fatemehN/ReproducibilityStudy.

📄 PDF Abstract BibTeX arXiv:2406.01765

Code (1)

fatemehn/reproducibilitystudy 공식 구현 pytorch

Tasks

Adversarial RobustnessObjectObject Tracking

Similar Papers 제목 키워드 기반

Mechanistic Understandings of Representation Vulnerabilities and Engineering Robust Vision Transformers

2025-02-07 · Chashi Mahiul Islam, Samuel Jacob Chacko, Mao Nishino, Xiuwen Liu

While transformer-based models dominate NLP and vision applications, their underlying mechanisms to map the input space to the label space semantically are not well understood. In this paper, we study the sources of know…

Zero-shot Generalization

SpecFormer: Guarding Vision Transformer Robustness via Maximum Singular Value Penalization

2024-01-02 · Xixu Hu, Runkai Zheng, Jindong Wang, Cheuk Hang Leung 외

Vision Transformers (ViTs) are increasingly used in computer vision due to their high performance, but their vulnerability to adversarial attacks is a concern. Existing methods lack a solid theoretical basis, focusing ma…

Computational Efficiency

Adversarial Robustness of In-Context Learning in Transformers for Linear Regression

2024-11-07 · Usman Anwar, Johannes von Oswald, Louis Kirsch, David Krueger 외

Transformers have demonstrated remarkable in-context learning capabilities across various domains, including statistical learning tasks. While previous work has shown that transformers can implement common learning algor…

Adversarial RobustnessIn-Context Learningregression

Exploring Adversarial Robustness of Vision Transformers in the Spectral Perspective

2022-08-20 · Gihyun Kim, Juyeop Kim, Jong-Seok Lee

The Vision Transformer has emerged as a powerful tool for image classification tasks, surpassing the performance of convolutional neural networks (CNNs). Recently, many researchers have attempted to understand the robust…

Adversarial Robustnessimage-classificationImage Classification

ViTGuard: Attention-aware Detection against Adversarial Examples for Vision Transformer

2024-09-20 · Shihua Sun, Kenechukwu Nwodo, Shridatt Sugrim, Angelos Stavrou 외

The use of transformers for vision tasks has challenged the traditional dominant role of convolutional neural networks (CNN) in computer vision (CV). For image classification tasks, Vision Transformer (ViT) effectively e…

image-classificationImage ClassificationImage Reconstruction