Attention-based Shape and Gait Representations Learning for Video-based Cloth-Changing Person Re-Identification
Current state-of-the-art Video-based Person Re-Identification (Re-ID) primarily relies on appearance features extracted by deep learning models. These methods are not applicable for long-term analysis in real-world scenarios where persons have changed clothes, making appearance information unreliable. In this work, we deal with the practical problem of Video-based Cloth-Changing Person Re-ID (VCCRe-ID) by proposing "Attention-based Shape and Gait Representations Learning" (ASGL) for VCCRe-ID. Our ASGL framework improves Re-ID performance under clothing variations by learning clothing-invariant gait cues using a Spatial-Temporal Graph Attention Network (ST-GAT). Given the 3D-skeleton-based spatial-temporal graph, our proposed ST-GAT comprises multi-head attention modules, which are able to enhance the robustness of gait embeddings under viewpoint changes and occlusions. The ST-GAT amplifies the important motion ranges and reduces the influence of noisy poses. Then, the multi-head learning module effectively reserves beneficial local temporal dynamics of movement. We also boost discriminative power of person representations by learning body shape cues using a GAT. Experiments on two large-scale VCCRe-ID datasets demonstrate that our proposed framework outperforms state-of-the-art methods by 12.2% in rank-1 accuracy and 7.0% in mAP.
Code (0)
등록된 구현이 없습니다.
Tasks
Cloth-Changing Person Re-IdentificationGraph AttentionPerson Re-IdentificationVideo-Based Person Re-IdentificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Temporal 3D Shape Modeling for Video-Based Cloth-Changing Person Re-Identification
Video-based Cloth-Changing Person Re-ID (VCCRe-ID) refers to a real-world Re-ID problem where texture information like appearance or clothing becomes unreliable in long-term, limiting the applicability of traditional Re-…
3D Shape ModelingCloth-Changing Person Re-IdentificationPerson Re-IdentificationAn In-Depth Exploration of Person Re-Identification and Gait Recognition in Cloth-Changing Conditions
The target of person re-identification (ReID) and gait recognition is consistent, that is to match the target pedestrian under surveillance cameras. For the cloth-changing problem, video-based ReID is rarely studied …
16kGait RecognitionPerson Re-IdentificationReducing Training Demands for 3D Gait Recognition with Deep Koopman Operator Constraints
Deep learning research has made many biometric recognition solution viable, but it requires vast training data to achieve real-world generalization. Unlike other biometric traits, such as face and ear, gait samples canno…
Gait RecognitionClothes-Changing Person Re-identification with RGB Modality Only
The key to address clothes-changing person re-identification (re-id) is to extract clothes-irrelevant features, e.g., face, hairstyle, body shape, and gait. Most current works mainly focus on modeling body shape from mul…
Clothes Changing Person Re-IdentificationMultiview Gait RecognitionPerson Re-IdentificationGait Identification under Surveillance Environment based on Human Skeleton
As an emerging biological identification technology, vision-based gait identification is an important research content in biometrics. Most existing gait identification methods extract features from gait videos and identi…
Gait Identification