Understanding the Robustness of Skeleton-based Action Recognition under Adversarial Attack
Action recognition has been heavily employed in many applications such as autonomous vehicles, surveillance, etc, where its robustness is a primary concern. In this paper, we examine the robustness of state-of-the-art action recognizers against adversarial attack, which has been rarely investigated so far. To this end, we propose a new method to attack action recognizers that rely on 3D skeletal motion. Our method involves an innovative perceptual loss that ensures the imperceptibility of the attack. Empirical studies demonstrate that our method is effective in both white-box and black-box scenarios. Its generalizability is evidenced on a variety of action recognizers and datasets. Its versatility is shown in different attacking strategies. Its deceitfulness is proven in extensive perceptual studies. Our method shows that adversarial attack on 3D skeletal motions, one type of time-series data, is significantly different from traditional adversarial attack problems. Its success raises serious concern on the robustness of action recognizers and provides insights on potential improvements.
Code (1)
Tasks
Action RecognitionAdversarial AttackAutonomous VehiclesSkeleton Based Action RecognitionTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Fourier Analysis on Robustness of Graph Convolutional Neural Networks for Skeleton-based Action Recognition
Using Fourier analysis, we explore the robustness and vulnerability of graph convolutional neural networks (GCNs) for skeleton-based action recognition. We adopt a joint Fourier transform (JFT), a combination of the grap…
Action Recognitionimage-classificationImage ClassificationSkeleton Based Action RecognitionAdversarial Robustness in RGB-Skeleton Action Recognition: Leveraging Attention Modality Reweighter
Deep neural networks (DNNs) have been applied in many computer vision tasks and achieved state-of-the-art (SOTA) performance. However, misclassification will occur when DNNs predict adversarial examples which are created…
Action RecognitionAdversarial RobustnessVideo Understanding3D Skeleton-Based Action Recognition: A Review
With the inherent advantages of skeleton representation, 3D skeleton-based action recognition has become a prominent topic in the field of computer vision. However, previous reviews have predominantly adopted a model-ori…
Action RecognitionData AugmentationMambaSkeleton Based Action RecognitionJoint Mixing Data Augmentation for Skeleton-based Action Recognition
Skeleton-based action recognition is beneficial for understanding human behavior in videos, and thus has received much attention in recent years as an important research area in action recognition. Current research focus…
Action RecognitionData AugmentationSkeleton Based Action RecognitionA New Adjacency Matrix Configuration in GCN-based Models for Skeleton-based Action Recognition
Human skeleton data has received increasing attention in action recognition due to its background robustness and high efficiency. In skeleton-based action recognition, graph convolutional network (GCN) has become the mai…
Action RecognitionSkeleton Based Action Recognition