Combining the Silhouette and Skeleton Data for Gait Recognition
Gait recognition, a long-distance biometric technology, has aroused intense interest recently. Currently, the two dominant gait recognition works are appearance-based and model-based, which extract features from silhouettes and skeletons, respectively. However, appearance-based methods are greatly affected by clothes-changing and carrying conditions, while model-based methods are limited by the accuracy of pose estimation. To tackle this challenge, a simple yet effective two-branch network is proposed in this paper, which contains a CNN-based branch taking silhouettes as input and a GCN-based branch taking skeletons as input. In addition, for better gait representation in the GCN-based branch, we present a fully connected graph convolution operator to integrate multi-scale graph convolutions and alleviate the dependence on natural joint connections. Also, we deploy a multi-dimension attention module named STC-Att to learn spatial, temporal and channel-wise attention simultaneously. The experimental results on CASIA-B and OUMVLP show that our method achieves state-of-the-art performance in various conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
Gait RecognitionPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GaitSTR: Gait Recognition with Sequential Two-stream Refinement
Gait recognition aims to identify a person based on their walking sequences, serving as a useful biometric modality as it can be observed from long distances without requiring cooperation from the subject. In representin…
Gait RecognitionMultiview Gait RecognitionGaitRef: Gait Recognition with Refined Sequential Skeletons
Identifying humans with their walking sequences, known as gait recognition, is a useful biometric understanding task as it can be observed from a long distance and does not require cooperation from the subject. Two commo…
Gait RecognitionMultiview Gait RecognitionLearning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes
Gait recognition captures gait patterns from the walking sequence of an individual for identification. Most existing gait recognition methods learn features from silhouettes or skeletons for the robustness to clothing, c…
Gait IdentificationGait RecognitionSkeletonGait: Gait Recognition Using Skeleton Maps
The choice of the representations is essential for deep gait recognition methods. The binary silhouettes and skeletal coordinates are two dominant representations in recent literature, achieving remarkable advances in ma…
Gait RecognitionGaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognition
Gait recognition is a promising video-based biometric for identifying individual walking patterns from a long distance. At present, most gait recognition methods use silhouette images to represent a person in each frame.…
Gait RecognitionMultiview Gait RecognitionPose Estimation