TriGait: Aligning and Fusing Skeleton and Silhouette Gait Data via a Tri-Branch Network
Gait recognition is a promising biometric technology for identification due to its non-invasiveness and long-distance. However, external variations such as clothing changes and viewpoint differences pose significant challenges to gait recognition. Silhouette-based methods preserve body shape but neglect internal structure information, while skeleton-based methods preserve structure information but omit appearance. To fully exploit the complementary nature of the two modalities, a novel triple branch gait recognition framework, TriGait, is proposed in this paper. It effectively integrates features from the skeleton and silhouette data in a hybrid fusion manner, including a two-stream network to extract static and motion features from appearance, a simple yet effective module named JSA-TC to capture dependencies between all joints, and a third branch for cross-modal learning by aligning and fusing low-level features of two modalities. Experimental results demonstrate the superiority and effectiveness of TriGait for gait recognition. The proposed method achieves a mean rank-1 accuracy of 96.0% over all conditions on CASIA-B dataset and 94.3% accuracy for CL, significantly outperforming all the state-of-the-art methods. The source code will be available at https://github.com/feng-xueling/TriGait/.
Code (1)
Tasks
Gait RecognitionSimilar Papers 제목 키워드 기반
GaitSTR: Gait Recognition with Sequential Two-stream Refinement
Gait recognition aims to identify a person based on their walking sequences, serving as a useful biometric modality as it can be observed from long distances without requiring cooperation from the subject. In representin…
Gait RecognitionMultiview Gait RecognitionSkeletonGait: Gait Recognition Using Skeleton Maps
The choice of the representations is essential for deep gait recognition methods. The binary silhouettes and skeletal coordinates are two dominant representations in recent literature, achieving remarkable advances in ma…
Gait RecognitionGaitRef: Gait Recognition with Refined Sequential Skeletons
Identifying humans with their walking sequences, known as gait recognition, is a useful biometric understanding task as it can be observed from a long distance and does not require cooperation from the subject. Two commo…
Gait RecognitionMultiview Gait RecognitionLearning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes
Gait recognition captures gait patterns from the walking sequence of an individual for identification. Most existing gait recognition methods learn features from silhouettes or skeletons for the robustness to clothing, c…
Gait IdentificationGait RecognitionGaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognition
Gait recognition is a promising video-based biometric for identifying individual walking patterns from a long distance. At present, most gait recognition methods use silhouette images to represent a person in each frame.…
Gait RecognitionMultiview Gait RecognitionPose Estimation