paper-with-me

홈 › Papers

CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification

2021-01-21 · ICCV 2021 10 · Chaoyou Fu, Yibo Hu, Xiang Wu, Hailin Shi, Tao Mei, Ran He

Visible-Infrared person re-identification (VI-ReID) aims to match cross-modality pedestrian images, breaking through the limitation of single-modality person ReID in dark environment. In order to mitigate the impact of large modality discrepancy, existing works manually design various two-stream architectures to separately learn modality-specific and modality-sharable representations. Such a manual design routine, however, highly depends on massive experiments and empirical practice, which is time consuming and labor intensive. In this paper, we systematically study the manually designed architectures, and identify that appropriately separating Batch Normalization (BN) layers is the key to bring a great boost towards cross-modality matching. Based on this observation, the essential objective is to find the optimal separation scheme for each BN layer. To this end, we propose a novel method, named Cross-Modality Neural Architecture Search (CM-NAS). It consists of a BN-oriented search space in which the standard optimization can be fulfilled subject to the cross-modality task. Equipped with the searched architecture, our method outperforms state-of-the-art counterparts in both two benchmarks, improving the Rank-1/mAP by 6.70%/6.13% on SYSU-MM01 and by 12.17%/11.23% on RegDB. Code is released at https://github.com/JDAI-CV/CM-NAS.

📄 PDF Abstract BibTeX arXiv:2101.08467

Code (1)

jdai-cv/cm-nas 공식 구현 pytorch

Tasks

Neural Architecture SearchPerson Re-Identification

Methods 이 논문이 사용한 방법론

Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

Augmented Dual-Contrastive Aggregation Learning for Unsupervised Visible-Infrared Person Re-Identification

2022-10-14 · ACM MM 2022 10 · Bin Yang, Mang Ye, Jun Chen, Zesen Wu

Visible infrared person re-identification (VI-ReID) aims at searching out the corresponding infrared (visible) images from a gallery set captured by other spectrum cameras. Recent works mainly focus on supervised VI-ReID…

Contrastive LearningPerson Re-Identification

Homogeneous and Heterogeneous Relational Graph for Visible-infrared Person Re-identification

2021-09-18 · Yujian Feng, Feng Chen, Jian Yu, Yimu Ji 외

Visible-infrared person re-identification (VI Re-ID) aims to match person images between the visible and infrared modalities. Existing VI Re-ID methods mainly focus on extracting homogeneous structural relationships in a…

Person Re-Identification

Frequency Domain Modality-invariant Feature Learning for Visible-infrared Person Re-Identification

2024-01-03 · Yulin Li, Tianzhu Zhang, Yongdong Zhang

Visible-infrared person re-identification (VI-ReID) is challenging due to the significant cross-modality discrepancies between visible and infrared images. While existing methods have focused on designing complex network…

Metric LearningPerson Re-Identification

Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration

2022-05-24 · Di Wang, JinYuan Liu, Xin Fan, Risheng Liu

Recent learning-based image fusion methods have marked numerous progress in pre-registered multi-modality data, but suffered serious ghosts dealing with misaligned multi-modality data, due to the spatial deformation and …

Image GenerationInfrared And Visible Image FusionStyle Transfer

How Image Generation Helps Visible-to-Infrared Person Re-Identification?

2022-10-04 · Honghu Pan, Yongyong Chen, Yunqi He, Xin Li 외

Compared to visible-to-visible (V2V) person re-identification (ReID), the visible-to-infrared (V2I) person ReID task is more challenging due to the lack of sufficient training samples and the large cross-modality discrep…

Image GenerationPerson Re-Identification