Simultaneous Face Hallucination and Translation for Thermal to Visible Face Verification using Axial-GAN
Existing thermal-to-visible face verification approaches expect the thermal and visible face images to be of similar resolution. This is unlikely in real-world long-range surveillance systems, since humans are distant from the cameras. To address this issue, we introduce the task of thermal-to-visible face verification from low-resolution thermal images. Furthermore, we propose Axial-Generative Adversarial Network (Axial-GAN) to synthesize high-resolution visible images for matching. In the proposed approach we augment the GAN framework with axial-attention layers which leverage the recent advances in transformers for modelling long-range dependencies. We demonstrate the effectiveness of the proposed method by evaluating on two different thermal-visible face datasets. When compared to related state-of-the-art works, our results show significant improvements in both image quality and face verification performance, and are also much more efficient.
Code (1)
Tasks
Face HallucinationFace VerificationGenerative Adversarial NetworkHallucinationTranslationSimilar Papers 제목 키워드 기반
Generating Thermal Human Faces for Physiological Assessment Using Thermal Sensor Auxiliary Labels
Thermal images reveal medically important physiological information about human stress, signs of inflammation, and emotional mood that cannot be seen on visible images. Providing a method to generate thermal faces from v…
SSIMTransfer LearningTranslationLearning Domain and Pose Invariance for Thermal-to-Visible Face Recognition
Interest in thermal to visible face recognition has grown significantly over the last decade due to advancements in thermal infrared cameras and analytics beyond the visible spectrum. Despite large discrepancies between …
Face RecognitionT2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models
Modern-day surveillance systems perform person recognition using deep learning-based face verification networks. Most state-of-the-art facial verification systems are trained using visible spectrum images. But, acquiring…
Face VerificationPerson RecognitionThermal Image DenoisingTranslationA Generative Approach for Image Registration of Visible-Thermal (VT) Cancer Faces
Since thermal imagery offers a unique modality to investigate pain, the U.S. National Institutes of Health (NIH) has collected a large and diverse set of cancer patient facial thermograms for AI-based pain research. Howe…
Image RegistrationThermal to Visible Image Synthesis under Atmospheric Turbulence
In many practical applications of long-range imaging such as biometrics and surveillance, thermal imagining modalities are often used to capture images in low-light and nighttime conditions. However, such imaging systems…
Face VerificationImage GenerationTranslation