From Modalities to Styles: Rethinking the Domain Gap in Heterogeneous Face Recognition
Heterogeneous Face Recognition (HFR) focuses on matching faces from different domains, for instance, thermal to visible images, making Face Recognition (FR) systems more versatile for challenging scenarios. However, the domain gap between these domains and the limited large-scale datasets in the target HFR modalities make it challenging to develop robust HFR models from scratch. In our work, we view different modalities as distinct styles and propose a method to modulate feature maps of the target modality to address the domain gap. We present a new Conditional Adaptive Instance Modulation (CAIM ) module that seamlessly fits into existing FR networks, turning them into HFR-ready systems. The CAIM block modulates intermediate feature maps, efficiently adapting to the style of the source modality and bridging the domain gap. Our method enables end-to-end training using a small set of paired samples. We extensively evaluate the proposed approach on various challenging HFR benchmarks, showing that it outperforms state-of-the-art methods. The source code and protocols for reproducing the findings will be made publicly available
Code (0)
등록된 구현이 없습니다.
Tasks
Face RecognitionHeterogeneous Face RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bridging the Gap: Heterogeneous Face Recognition with Conditional Adaptive Instance Modulation
Heterogeneous Face Recognition (HFR) aims to match face images across different domains, such as thermal and visible spectra, expanding the applicability of Face Recognition (FR) systems to challenging scenarios. However…
Face RecognitionHeterogeneous Face RecognitionPrepended Domain Transformer: Heterogeneous Face Recognition without Bells and Whistles
Heterogeneous Face Recognition (HFR) refers to matching face images captured in different domains, such as thermal to visible images (VIS), sketches to visible images, near-infrared to visible, and so on. This is particu…
Contrastive LearningFace RecognitionHeterogeneous Face RecognitionStyleverse: Towards Identity Stylization across Heterogeneous Domains
We propose a new challenging task namely IDentity Stylization (IDS) across heterogeneous domains. IDS focuses on stylizing the content identity, rather than completely swapping it using the reference identity. We use an …
Style TransferCoupled Deep Learning for Heterogeneous Face Recognition
Heterogeneous face matching is a challenge issue in face recognition due to large domain difference as well as insufficient pairwise images in different modalities during training. This paper proposes a coupled deep lear…
Deep LearningFace RecognitionHeterogeneous Face RecognitionTripletModality Agnostic Heterogeneous Face Recognition with Switch Style Modulators
Heterogeneous Face Recognition (HFR) systems aim to enhance the capability of face recognition in challenging cross-modal authentication scenarios. However, the significant domain gap between the source and target modali…
Face RecognitionHeterogeneous Face Recognition