CoReFusion: Contrastive Regularized Fusion for Guided Thermal Super-Resolution
Thermal imaging has numerous advantages over regular visible-range imaging since it performs well in low-light circumstances. Super-Resolution approaches can broaden their usefulness by replicating accurate high-resolution thermal pictures using measurements from low-cost, low-resolution thermal sensors. Because of the spectral range mismatch between the images, Guided Super-Resolution of thermal images utilizing visible range images is difficult. However, In case of failure to capture Visible Range Images can prevent the operations of applications in critical areas. We present a novel data fusion framework and regularization technique for Guided Super Resolution of Thermal images. The proposed architecture is computationally in-expensive and lightweight with the ability to maintain performance despite missing one of the modalities, i.e., high-resolution RGB image or the lower-resolution thermal image, and is designed to be robust in the presence of missing data. The proposed method presents a promising solution to the frequently occurring problem of missing modalities in a real-world scenario. Code is available at https://github.com/Kasliwal17/CoReFusion .
Code (1)
Tasks
Super-ResolutionSimilar Papers 제목 키워드 기반
ScoreFusion: Fusing Score-based Generative Models via Kullback-Leibler Barycenters
We introduce ScoreFusion, a theoretically grounded method for fusing multiple pre-trained diffusion models that are assumed to generate from auxiliary populations. ScoreFusion is particularly useful for enhancing the gen…
DenoisingCoReGAN: Contrastive Regularized Generative Adversarial Network for Guided Depth Map Super Resolution
Consumer-grade depth sensors provide low-resolution depth maps; however, a high-resolution RGB camera is usually mounted on the same device and acquires a high-resolution image of the same scene. While deep learning and …
Contrastive LearningDecoderDepth Map Super-ResolutionGenerative Adversarial Network+1IGFNet: Illumination-Guided Fusion Network for Semantic Scene Understanding using RGB-Thermal Images
Semantic scene understanding is a fundamental task for autonomous driving. It serves as a build block for many downstream tasks. Under challenging illumination conditions, thermal images can provide complementary informa…
Autonomous DrivingScene UnderstandingThermal Image SegmentationData Generation Scheme for Thermal Modality with Edge-Guided Adversarial Conditional Diffusion Model
In challenging low light and adverse weather conditions,thermal vision algorithms,especially object detection,have exhibited remarkable potential,contrasting with the frequent struggles encountered by visible vision algo…
Image Generationobject-detectionObject DetectionSwinFuSR: an image fusion-inspired model for RGB-guided thermal image super-resolution
Thermal imaging plays a crucial role in various applications, but the inherent low resolution of commonly available infrared (IR) cameras limits its effectiveness. Conventional super-resolution (SR) methods often struggl…
Image Super-ResolutionSSIMSuper-Resolution