paper-with-me

Papers

Deep Perceptual Mapping for Cross-Modal Face Recognition

2016-01-20 · M. Saquib Sarfraz, Rainer Stiefelhagen

Cross modal face matching between the thermal and visible spectrum is a much desired capability for night-time surveillance and security applications. Due to a very large modality gap, thermal-to-visible face recognition is one of the most challenging face matching problem. In this paper, we present an approach to bridge this modality gap by a significant margin. Our approach captures the highly non-linear relationship between the two modalities by using a deep neural network. Our model attempts to learn a non-linear mapping from visible to thermal spectrum while preserving the identity information. We show substantive performance improvement on three difficult thermal-visible face datasets. The presented approach improves the state-of-the-art by more than 10\% on UND-X1 dataset and by more than 15-30\% on NVESD dataset in terms of Rank-1 identification. Our method bridges the drop in performance due to the modality gap by more than 40\%.

📄 PDF Abstract BibTeX arXiv:1601.05347

Code (0)

등록된 구현이 없습니다.

Tasks

Face Recognition

Similar Papers 제목 키워드 기반

Deep Perceptual Mapping for Thermal to Visible Face Recognition

2015-07-10 · M. Saquib Sarfraz, Rainer Stiefelhagen

Cross modal face matching between the thermal and visible spectrum is a much de- sired capability for night-time surveillance and security applications. Due to a very large modality gap, thermal-to-visible face recogniti…

Face Recognition

Visual-Tactile Cross-Modal Data Generation using Residue-Fusion GAN with Feature-Matching and Perceptual Losses

2021-07-12 · Shaoyu Cai, Kening Zhu, Yuki Ban, Takuji Narumi

Existing psychophysical studies have revealed that the cross-modal visual-tactile perception is common for humans performing daily activities. However, it is still challenging to build the algorithmic mapping from one mo…

Translation

CM2-Net: Continual Cross-Modal Mapping Network for Driver Action Recognition

2024-06-17 · Ruoyu Wang, Chen Cai, Wenqian Wang, Jianjun Gao 외

Driver action recognition has significantly advanced in enhancing driver-vehicle interactions and ensuring driving safety by integrating multiple modalities, such as infrared and depth. Nevertheless, compared to RGB moda…

Action RecognitionContinual Learning

Unifying Local and Global Multimodal Features for Place Recognition in Aliased and Low-Texture Environments

2024-03-20 · Alberto García-Hernández, Riccardo Giubilato, Klaus H. Strobl, Javier Civera 외

Perceptual aliasing and weak textures pose significant challenges to the task of place recognition, hindering the performance of Simultaneous Localization and Mapping (SLAM) systems. This paper presents a novel model, ca…

Re-RankingSimultaneous Localization and Mapping

Matching Thermal to Visible Face Images Using a Semantic-Guided Generative Adversarial Network

2019-03-03 · Cunjian Chen, Arun Ross

Designing face recognition systems that are capable of matching face images obtained in the thermal spectrum with those obtained in the visible spectrum is a challenging problem. In this work, we propose the use of seman…

Face GenerationFace ParsingFace RecognitionGenerative Adversarial Network