Leaning Compact and Representative Features for Cross-Modality Person Re-Identification
This paper pays close attention to the cross-modality visible-infrared person re-identification (VI Re-ID) task, which aims to match pedestrian samples between visible and infrared modes. In order to reduce the modality-discrepancy between samples from different cameras, most existing works usually use constraints based on Euclidean metric. Because of the Euclidean based distance metric strategy cannot effectively measure the internal angles between the embedded vectors, the existing solutions cannot learn the angularly discriminative feature embedding. Since the most important factor affecting the classification task based on embedding vector is whether there is an angularly discriminative feature space, in this paper, we present a new loss function called Enumerate Angular Triplet (EAT) loss. Also, motivated by the knowledge distillation, to narrow down the features between different modalities before feature embedding, we further present a novel Cross-Modality Knowledge Distillation (CMKD) loss. Benefit from the above two considerations, the embedded features are discriminative enough in a way to tackle modality-discrepancy problem. The experimental results on RegDB and SYSU-MM01 datasets have demonstrated that the proposed method is superior to the other most advanced methods in terms of impressive performance. Code is available at https://github.com/IVIPLab/LCCRF.
Code (1)
Tasks
Cross-Modality Person Re-identificationKnowledge DistillationPerson Re-IdentificationTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SC3EF: A Joint Self-Correlation and Cross-Correspondence Estimation Framework for Visible and Thermal Image Registration
Multispectral imaging plays a critical role in a range of intelligent transportation applications, including advanced driver assistance systems (ADAS), traffic monitoring, and night vision. However, accurate visible and …
Image RegistrationOptical Flow EstimationCSTrack: Enhancing RGB-X Tracking via Compact Spatiotemporal Features
Effectively modeling and utilizing spatiotemporal features from RGB and other modalities (\eg, depth, thermal, and event data, denoted as X) is the core of RGB-X tracker design. Existing methods often employ two parallel…
Extended Cross-Modality United Learning for Unsupervised Visible-Infrared Person Re-identification
Unsupervised learning visible-infrared person re-identification (USL-VI-ReID) aims to learn modality-invariant features from unlabeled cross-modality datasets and reduce the inter-modality gap. However, the existing meth…
ClusteringContrastive LearningPerson Re-IdentificationAudio-visual cross-modality knowledge transfer for machine learning-based in-situ monitoring in laser additive manufacturing
Various machine learning (ML)-based in-situ monitoring systems have been developed to detect anomalies and defects in laser additive manufacturing (LAM) processes. While multimodal fusion, which integrates data from visu…
Anomaly DetectionDefect DetectionExplainable artificial intelligenceTransfer LearningDomain Private and Agnostic Feature for Modality Adaptive Face Recognition
Heterogeneous face recognition is a challenging task due to the large modality discrepancy and insufficient cross-modal samples. Most existing works focus on discriminative feature transformation, metric learning and cro…
Face GenerationFace RecognitionHeterogeneous Face RecognitionMetric Learning