paper-with-me

Papers

From Modalities to Styles: Rethinking the Domain Gap in Heterogeneous Face Recognition

2024-04-22 · Anjith George, Sebastien Marcel

Heterogeneous Face Recognition (HFR) focuses on matching faces from different domains, for instance, thermal to visible images, making Face Recognition (FR) systems more versatile for challenging scenarios. However, the domain gap between these domains and the limited large-scale datasets in the target HFR modalities make it challenging to develop robust HFR models from scratch. In our work, we view different modalities as distinct styles and propose a method to modulate feature maps of the target modality to address the domain gap. We present a new Conditional Adaptive Instance Modulation (CAIM ) module that seamlessly fits into existing FR networks, turning them into HFR-ready systems. The CAIM block modulates intermediate feature maps, efficiently adapting to the style of the source modality and bridging the domain gap. Our method enables end-to-end training using a small set of paired samples. We extensively evaluate the proposed approach on various challenging HFR benchmarks, showing that it outperforms state-of-the-art methods. The source code and protocols for reproducing the findings will be made publicly available

📄 PDF Abstract BibTeX arXiv:2404.14247

Code (0)

등록된 구현이 없습니다.

Tasks

Face RecognitionHeterogeneous Face Recognition

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Bridging the Gap: Heterogeneous Face Recognition with Conditional Adaptive Instance Modulation

2023-07-13 · Anjith George, Sebastien Marcel

Heterogeneous Face Recognition (HFR) aims to match face images across different domains, such as thermal and visible spectra, expanding the applicability of Face Recognition (FR) systems to challenging scenarios. However…

Face RecognitionHeterogeneous Face Recognition

Prepended Domain Transformer: Heterogeneous Face Recognition without Bells and Whistles

2022-10-12 · Anjith George, Amir Mohammadi, Sebastien Marcel

Heterogeneous Face Recognition (HFR) refers to matching face images captured in different domains, such as thermal to visible images (VIS), sketches to visible images, near-infrared to visible, and so on. This is particu…

Contrastive LearningFace RecognitionHeterogeneous Face Recognition

Styleverse: Towards Identity Stylization across Heterogeneous Domains

2022-03-02 · Jia Li, Jie Cao, Junxian Duan, Ran He

We propose a new challenging task namely IDentity Stylization (IDS) across heterogeneous domains. IDS focuses on stylizing the content identity, rather than completely swapping it using the reference identity. We use an …

Style Transfer

Coupled Deep Learning for Heterogeneous Face Recognition

2017-04-08 · Xiang Wu, Lingxiao Song, Ran He, Tieniu Tan

Heterogeneous face matching is a challenge issue in face recognition due to large domain difference as well as insufficient pairwise images in different modalities during training. This paper proposes a coupled deep lear…

Deep LearningFace RecognitionHeterogeneous Face RecognitionTriplet

Modality Agnostic Heterogeneous Face Recognition with Switch Style Modulators

2024-07-11 · Anjith George, Sebastien Marcel

Heterogeneous Face Recognition (HFR) systems aim to enhance the capability of face recognition in challenging cross-modal authentication scenarios. However, the significant domain gap between the source and target modali…

Face RecognitionHeterogeneous Face Recognition