Robust Perceptual Night Vision in Thermal Colorization
Transforming a thermal infrared image into a robust perceptual colour Visible image is an ill-posed problem due to the differences in their spectral domains and in the objects' representations. Objects appear in one spectrum but not necessarily in the other, and the thermal signature of a single object may have different colours in its Visible representation. This makes a direct mapping from thermal to Visible images impossible and necessitates a solution that preserves texture captured in the thermal spectrum while predicting the possible colour for certain objects. In this work, a deep learning method to map the thermal signature from the thermal image's spectrum to a Visible representation in their low-frequency space is proposed. A pan-sharpening method is then used to merge the predicted low-frequency representation with the high-frequency representation extracted from the thermal image. The proposed model generates colour values consistent with the Visible ground truth when the object does not vary much in its appearance and generates averaged grey values in other cases. The proposed method shows robust perceptual night vision images in preserving the object's appearance and image context compared with the existing state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
ColorizationSimilar Papers 제목 키워드 기반
Thermal Infrared Image Colorization for Nighttime Driving Scenes with Top-Down Guided Attention
Benefitting from insensitivity to light and high penetration of foggy environments, infrared cameras are widely used for sensing in nighttime traffic scenes. However, the low contrast and lack of chromaticity of thermal …
ColorizationImage ColorizationTranslationMemory-Guided Collaborative Attention for Nighttime Thermal Infrared Image Colorization
Nighttime thermal infrared (NTIR) image colorization, also known as translation of NTIR images into daytime color images (NTIR2DC), is a promising research direction to facilitate nighttime scene perception for humans an…
ColorizationGenerative Adversarial NetworkImage ColorizationImage-to-Image Translation+3Nighttime Thermal Infrared Image Colorization with Feedback-based Object Appearance Learning
Stable imaging in adverse environments (e.g., total darkness) makes thermal infrared (TIR) cameras a prevalent option for night scene perception. However, the low contrast and lack of chromaticity of TIR images are detri…
ColorizationGenerative Adversarial NetworkImage ColorizationTranslationThermEval: A Structured Benchmark for Evaluation of Vision-Language Models on Thermal Imagery
Vision language models (VLMs) achieve strong performance on RGB imagery, but they do not generalize to thermal images. Thermal sensing plays a critical role in settings where visible light fails, including nighttime surv…
Visual Question AnsweringAutonomous DrivingUniversal computational thermal imaging overcoming the ghosting effect
Thermal imaging is crucial for night vision but fundamentally hampered by the ghosting effect, a loss of detailed texture in cluttered photon streams. While conventional ghosting mitigation has relied on data post-proces…