Cross-Modality Person Re-Identification via Modality Confusion and Center Aggregation
Cross-modality person re-identification is a challenging task due to large cross-modality discrepancy and intra-modality variations. Currently, most existing methods focus on learning modality-specific or modality-shareable features by using the identity supervision or modality label. Different from existing methods, this paper presents a novel Modality Confusion Learning Network (MCLNet). Its basic idea is to confuse two modalities, ensuring that the optimization is explicitly concentrated on the modality-irrelevant perspective. Specifically, MCLNet is designed to learn modality-invariant features by simultaneously minimizing inter-modality discrepancy while maximizing cross-modality similarity among instances in a single framework. Furthermore, an identity-aware marginal center aggregation strategy is introduced to extract the centralization features, while keeping diversity with a marginal constraint. Finally, we design a camera-aware learning scheme to enrich the discriminability. Extensive experiments on SYSU-MM01 and RegDB datasets show that MCLNet outperforms the state-of-the-art by a large margin. On the large-scale SYSU-MM01 dataset, our model can achieve 65.40% and 61.98% in terms of Rank-1 accuracy and mAP value.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Modality Person Re-identificationDiversityPerson Re-IdentificationSimilar Papers 제목 키워드 기반
Mix-Modality Person Re-Identification: A New and Practical Paradigm
Current visible-infrared cross-modality person re-identification research has only focused on exploring the bi-modality mutual retrieval paradigm, and we propose a new and more practical mix-modality retrieval paradigm. …
Cross-Modality Person Re-identificationPerson Re-IdentificationRetrievalFrom Cross-Modal to Mixed-Modal Visible-Infrared Re-Identification
Visible-infrared person re-identification (VI-ReID) aims to match individuals across different camera modalities, a critical task in modern surveillance systems. While current VI-ReID methods focus on cross-modality matc…
Person Re-IdentificationModality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification
RGB-infrared person re-identification is an emerging cross-modality re-identification task, which is very challenging due to significant modality discrepancy between RGB and infrared images. In this work, we propose a no…
Deep Reinforcement LearningPerson Re-IdentificationHetero-Center Loss for Cross-Modality Person Re-Identification
Cross-modality person re-identification is a challenging problem which retrieves a given pedestrian image in RGB modality among all the gallery images in infrared modality. The task can address the limitation of RGB-base…
Cross-Modality Person Re-identificationPerson Re-IdentificationExploring Modality-shared Appearance Features and Modality-invariant Relation Features for Cross-modality Person Re-Identification
Most existing cross-modality person re-identification works rely on discriminative modality-shared features for reducing cross-modality variations and intra-modality variations. Despite some initial success, such modalit…
Cross-Modality Person Re-identificationPerson Re-Identification