A Generative Approach for Image Registration of Visible-Thermal (VT) Cancer Faces
Since thermal imagery offers a unique modality to investigate pain, the U.S. National Institutes of Health (NIH) has collected a large and diverse set of cancer patient facial thermograms for AI-based pain research. However, differing angles from camera capture between thermal and visible sensors has led to misalignment between Visible-Thermal (VT) images. We modernize the classic computer vision task of image registration by applying and modifying a generative alignment algorithm to register VT cancer faces, without the need for a reference or alignment parameters. By registering VT faces, we demonstrate that the quality of thermal images produced in the generative AI downstream task of Visible-to-Thermal (V2T) image translation significantly improves up to 52.5\%, than without registration. Images in this paper have been approved by the NIH NCI for public dissemination.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RegistrationSimilar Papers 제목 키워드 기반
Vista-Morph: Unsupervised Image Registration of Visible-Thermal Facial Pairs
For a variety of biometric cross-spectral tasks, Visible-Thermal (VT) facial pairs are used. However, due to a lack of calibration in the lab, photographic capture between two different sensors leads to severely misalign…
Image RegistrationMORPHPerson Re-IdentificationUnsupervised Image RegistrationLearning Cross-Spectral Point Features with Task-Oriented Training
Unmanned aerial vehicles (UAVs) enable operations in remote and hazardous environments, yet the visible-spectrum, camera-based navigation systems often relied upon by UAVs struggle in low-visibility conditions. Thermal c…
Uncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Images
Infrared and Visible Image Fusion (IVIF) has shown promise in visual tasks under challenging environments, but fusion under unregistered conditions faces inherent misalignments. Current studies to solve them either predi…
Thermal to Visible Synthesis of Face Images using Multiple Regions
Synthesis of visible spectrum faces from thermal facial imagery is a promising approach for heterogeneous face recognition; enabling existing face recognition software trained on visible imagery to be leveraged, and allo…
Face RecognitionFacial Landmark DetectionHeterogeneous Face RecognitionImage RegistrationPolarimetric Thermal to Visible Face Verification via Attribute Preserved Synthesis
Thermal to visible face verification is a challenging problem due to the large domain discrepancy between the modalities. Existing approaches either attempt to synthesize visible faces from thermal faces or extract robus…
AttributeFace VerificationGenerative Adversarial Network