paper-with-me

홈 › Papers

Fourier Analysis on Robustness of Graph Convolutional Neural Networks for Skeleton-based Action Recognition

2023-05-29 · Nariki Tanaka, Hiroshi Kera, Kazuhiko Kawamoto

Using Fourier analysis, we explore the robustness and vulnerability of graph convolutional neural networks (GCNs) for skeleton-based action recognition. We adopt a joint Fourier transform (JFT), a combination of the graph Fourier transform (GFT) and the discrete Fourier transform (DFT), to examine the robustness of adversarially-trained GCNs against adversarial attacks and common corruptions. Experimental results with the NTU RGB+D dataset reveal that adversarial training does not introduce a robustness trade-off between adversarial attacks and low-frequency perturbations, which typically occurs during image classification based on convolutional neural networks. This finding indicates that adversarial training is a practical approach to enhancing robustness against adversarial attacks and common corruptions in skeleton-based action recognition. Furthermore, we find that the Fourier approach cannot explain vulnerability against skeletal part occlusion corruption, which highlights its limitations. These findings extend our understanding of the robustness of GCNs, potentially guiding the development of more robust learning methods for skeleton-based action recognition.

📄 PDF Abstract BibTeX arXiv:2305.17939

Code (1)

nntanaka/Fourier-Analysis-for-Skeleton-based-Action-Recognition 공식 구현 pytorch

Tasks

Action Recognitionimage-classificationImage ClassificationSkeleton Based Action Recognition

Similar Papers 제목 키워드 기반

A New Adjacency Matrix Configuration in GCN-based Models for Skeleton-based Action Recognition

2022-06-29 · Zheng Fang, Xiongwei Zhang, Tieyong Cao, Yunfei Zheng 외

Human skeleton data has received increasing attention in action recognition due to its background robustness and high efficiency. In skeleton-based action recognition, graph convolutional network (GCN) has become the mai…

Action RecognitionSkeleton Based Action Recognition

Richly Activated Graph Convolutional Network for Action Recognition with Incomplete Skeletons

2019-05-16 · Yi-Fan Song, Zhang Zhang, Liang Wang

Current methods for skeleton-based human action recognition usually work with completely observed skeletons. However, in real scenarios, it is prone to capture incomplete and noisy skeletons, which will deteriorate the p…

Action RecognitionSkeleton Based Action RecognitionTemporal Action Localization

Spatial Transformer Network on Skeleton-based Gait Recognition

2022-04-08 · Cun Zhang, Xing-Peng Chen, Guo-Qiang Han, Xiang-Jie Liu

Skeleton-based gait recognition models usually suffer from the robustness problem, as the Rank-1 accuracy varies from 90\% in normal walking cases to 70\% in walking with coats cases. In this work, we propose a state-of-…

Gait Recognition

Action Segmentation Using 2D Skeleton Heatmaps and Multi-Modality Fusion

2023-09-12 · Syed Waleed Hyder, Muhammad Usama, Anas Zafar, Muhammad Naufil 외

This paper presents a 2D skeleton-based action segmentation method with applications in fine-grained human activity recognition. In contrast with state-of-the-art methods which directly take sequences of 3D skeleton coor…

Action SegmentationActivity RecognitionHuman Activity RecognitionSegmentation+1

Skeleton-Based Intake Gesture Detection With Spatial-Temporal Graph Convolutional Networks

2025-04-14 · Chunzhuo Wang, Zhewen Xue, T. Sunil Kumar, Guido Camps 외

Overweight and obesity have emerged as widespread societal challenges, frequently linked to unhealthy eating patterns. A promising approach to enhance dietary monitoring in everyday life involves automated detection of f…