paper-with-me

Papers

Attention-based Shape and Gait Representations Learning for Video-based Cloth-Changing Person Re-Identification

2024-02-06 · Vuong D. Nguyen, Samiha Mirza, Pranav Mantini, Shishir K. Shah

Current state-of-the-art Video-based Person Re-Identification (Re-ID) primarily relies on appearance features extracted by deep learning models. These methods are not applicable for long-term analysis in real-world scenarios where persons have changed clothes, making appearance information unreliable. In this work, we deal with the practical problem of Video-based Cloth-Changing Person Re-ID (VCCRe-ID) by proposing "Attention-based Shape and Gait Representations Learning" (ASGL) for VCCRe-ID. Our ASGL framework improves Re-ID performance under clothing variations by learning clothing-invariant gait cues using a Spatial-Temporal Graph Attention Network (ST-GAT). Given the 3D-skeleton-based spatial-temporal graph, our proposed ST-GAT comprises multi-head attention modules, which are able to enhance the robustness of gait embeddings under viewpoint changes and occlusions. The ST-GAT amplifies the important motion ranges and reduces the influence of noisy poses. Then, the multi-head learning module effectively reserves beneficial local temporal dynamics of movement. We also boost discriminative power of person representations by learning body shape cues using a GAT. Experiments on two large-scale VCCRe-ID datasets demonstrate that our proposed framework outperforms state-of-the-art methods by 12.2% in rank-1 accuracy and 7.0% in mAP.

📄 PDF Abstract BibTeX arXiv:2402.03716

Code (0)

등록된 구현이 없습니다.

Tasks

Cloth-Changing Person Re-IdentificationGraph AttentionPerson Re-IdentificationVideo-Based Person Re-Identification

Methods 이 논문이 사용한 방법론

Attention 설명 없음
GAT A Graph Attention Network (GAT) is a neural network architecture that operates on graph-structured data, leveraging masked self-attentional layers to address the shortcomings…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Temporal 3D Shape Modeling for Video-Based Cloth-Changing Person Re-Identification

2024-01-04 · IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops 2024 1 · Vuong D. Nguyen, Pranav Mantini, Shishir K. Shah

Video-based Cloth-Changing Person Re-ID (VCCRe-ID) refers to a real-world Re-ID problem where texture information like appearance or clothing becomes unreliable in long-term, limiting the applicability of traditional Re-…

3D Shape ModelingCloth-Changing Person Re-IdentificationPerson Re-Identification

An In-Depth Exploration of Person Re-Identification and Gait Recognition in Cloth-Changing Conditions

2023-01-01 · CVPR 2023 1 · Weijia Li, Saihui Hou, Chunjie Zhang, Chunshui Cao 외

The target of person re-identification (ReID) and gait recognition is consistent, that is to match the target pedestrian under surveillance cameras. For the cloth-changing problem, video-based ReID is rarely studied …

16kGait RecognitionPerson Re-Identification

Reducing Training Demands for 3D Gait Recognition with Deep Koopman Operator Constraints

2023-08-14 · Cole Hill, Mauricio Pamplona Segundo, Sudeep Sarkar

Deep learning research has made many biometric recognition solution viable, but it requires vast training data to achieve real-world generalization. Unlike other biometric traits, such as face and ear, gait samples canno…

Gait Recognition

Clothes-Changing Person Re-identification with RGB Modality Only

2022-04-14 · CVPR 2022 1 · Xinqian Gu, Hong Chang, Bingpeng Ma, Shutao Bai 외

The key to address clothes-changing person re-identification (re-id) is to extract clothes-irrelevant features, e.g., face, hairstyle, body shape, and gait. Most current works mainly focus on modeling body shape from mul…

Clothes Changing Person Re-IdentificationMultiview Gait RecognitionPerson Re-Identification

Gait Identification under Surveillance Environment based on Human Skeleton

2021-11-23 · Xingkai Zheng, Xirui Li, Ke Xu, Xinghao Jiang 외

As an emerging biological identification technology, vision-based gait identification is an important research content in biometrics. Most existing gait identification methods extract features from gait videos and identi…

Gait Identification