Generalizable Person Re-Identification via Viewpoint Alignment and Fusion
In the current person Re-identification (ReID) methods, most domain generalization works focus on dealing with style differences between domains while largely ignoring unpredictable camera view change, which we identify as another major factor leading to a poor generalization of ReID methods. To tackle the viewpoint change, this work proposes to use a 3D dense pose estimation model and a texture mapping module to map the pedestrian images to canonical view images. Due to the imperfection of the texture mapping module, the canonical view images may lose the discriminative detail clues from the original images, and thus directly using them for ReID will inevitably result in poor performance. To handle this issue, we propose to fuse the original image and canonical view image via a transformer-based module. The key insight of this design is that the cross-attention mechanism in the transformer could be an ideal solution to align the discriminative texture clues from the original image with the canonical view image, which could compensate for the low-quality texture information of the canonical view image. Through extensive experiments, we show that our method can lead to superior performance over the existing approaches in various evaluation settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain GeneralizationGeneralizable Person Re-identificationPerson Re-IdentificationPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Generalizable Person Re-identification with a Bi-stream Generative Model
Generalizable person re-identification (re-ID) has attracted growing attention due to its powerful adaptation capability in the unseen data domain. However, existing solutions often neglect either crossing cameras (e.g.,…
Domain GeneralizationGeneralizable Person Re-identificationPerson Re-IdentificationLearning Domain Invariant Representations for Generalizable Person Re-Identification
Generalizable person Re-Identification (ReID) has attracted growing attention in recent computer vision community. In this work, we construct a structural causal model among identity labels, identity-specific factors (cl…
Data AugmentationDomain GeneralizationGeneralizable Person Re-identificationPerson Re-Identification+1Interpretable and Generalizable Person Re-Identification with Query-Adaptive Convolution and Temporal Lifting
For person re-identification, existing deep networks often focus on representation learning. However, without transfer learning, the learned model is fixed as is, which is not adaptable for handling various unseen scenar…
Domain GeneralizationGeneralizable Person Re-identificationMetric LearningPerson Re-Identification+1GAN-based Pose-aware Regulation for Video-based Person Re-identification
Video-based person re-identification deals with the inherent difficulty of matching unregulated sequences with different length and with incomplete target pose/viewpoint structure. Common approaches operate either by red…
Person Re-IdentificationVideo-Based Person Re-IdentificationView-Aware Semantic Alignment for Aerial-Ground Person Re-Identification
Aerial-Ground Person Re-Identification (AGPReID) remains highly challenging due to drastic viewpoint variations between drones and fixed cameras. Existing methods typically follow a view-invariant paradigm, aligning shar…
Person Re-Identification