Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos
Video-based person re-identification aims to match pedestrians from video sequences across non-overlapping camera views. The key factor for video person re-identification is to effectively exploit both spatial and temporal clues from video sequences. In this work, we propose a novel Spatial-Temporal Correlation and Topology Learning framework (CTL) to pursue discriminative and robust representation by modeling cross-scale spatial-temporal correlation. Specifically, CTL utilizes a CNN backbone and a key-points estimator to extract semantic local features from human body at multiple granularities as graph nodes. It explores a context-reinforced topology to construct multi-scale graphs by considering both global contextual information and physical connections of human body. Moreover, a 3D graph convolution and a cross-scale graph convolution are designed, which facilitate direct cross-spacetime and cross-scale information propagation for capturing hierarchical spatial-temporal dependencies and structural information. By jointly performing the two convolutions, CTL effectively mines comprehensive clues that are complementary with appearance information to enhance representational capacity. Extensive experiments on two video benchmarks have demonstrated the effectiveness of the proposed method and the state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Person Re-IdentificationVideo-Based Person Re-IdentificationVideo DeinterlacingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pyramid Spatial-Temporal Aggregation for Video-Based Person Re-Identification
Video-based person re-identification aims to associate the video clips of the same person across multiple non-overlapping cameras. Spatial-temporal representations can provide richer and complementary information bet…
Person Re-IdentificationVideo-Based Person Re-IdentificationCo-Saliency Spatio-Temporal Interaction Network for Person Re-Identification in Videos
Person re-identification aims at identifying a certain pedestrian across non-overlapping camera networks. Video-based re-identification approaches have gained significant attention recently, expanding image-based approac…
Person Re-IdentificationJoint Person Re-identification and Camera Network Topology Inference in Multiple Cameras
Person re-identification is the task of recognizing or identifying a person across multiple views in multi-camera networks. Although there has been much progress in person re-identification, person re-identification in l…
Person Re-IdentificationObject Re-identification via Spatial-temporal Fusion Networks and Causal Identity Matching
Object re-identification (ReID) in large camera networks faces numerous challenges. First, the similar appearances of objects degrade ReID performance, a challenge that needs to be addressed by existing appearance-based …
Watching You: Global-guided Reciprocal Learning for Video-based Person Re-identification
Video-based person re-identification (Re-ID) aims to automatically retrieve video sequences of the same person under non-overlapping cameras. To achieve this goal, it is the key to fully utilize abundant spatial and temp…
Feature CorrelationPerson Re-IdentificationVideo-Based Person Re-Identification