A Dual-branch Network for Infrared and Visible Image Fusion
Deep learning is a rapidly developing approach in the field of infrared and visible image fusion. In this context, the use of dense blocks in deep networks significantly improves the utilization of shallow information, and the combination of the Generative Adversarial Network (GAN) also improves the fusion performance of two source images. We propose a new method based on dense blocks and GANs , and we directly insert the input image-visible light image in each layer of the entire network. We use SSIM and gradient loss functions that are more consistent with perception instead of mean square error loss. After the adversarial training between the generator and the discriminator, we show that a trained end-to-end fusion network -- the generator network -- is finally obtained. Our experiments show that the fused images obtained by our approach achieve good score based on multiple evaluation indicators. Further, our fused images have better visual effects in multiple sets of contrasts, which are more satisfying to human visual perception.
Code (2)
Tasks
Generative Adversarial NetworkInfrared And Visible Image FusionSSIMSimilar Papers 제목 키워드 기반
DAF-Net: A Dual-Branch Feature Decomposition Fusion Network with Domain Adaptive for Infrared and Visible Image Fusion
Infrared and visible image fusion aims to combine complementary information from both modalities to provide a more comprehensive scene understanding. However, due to the significant differences between the two modalities…
Infrared And Visible Image FusionScene UnderstandingA Joint Convolution Auto-encoder Network for Infrared and Visible Image Fusion
Background: Leaning redundant and complementary relationships is a critical step in the human visual system. Inspired by the infrared cognition ability of crotalinae animals, we design a joint convolution auto-encoder (J…
DecoderInfrared And Visible Image FusionDAAF:Degradation-Aware Adaptive Fusion Framework for Robust Infrared and Visible Images Fusion
Existing infrared and visible image fusion(IVIF) algorithms often prioritize high-quality images, neglecting image degradation such as low light and noise, which limits the practical potential. This paper propose Degrada…
Infrared And Visible Image FusionDual-Branch Remote Sensing Infrared Image Super-Resolution
Remote sensing infrared image super-resolution aims to recover sharper thermal observations from low-resolution inputs while preserving target contours, scene layout, and radiometric stability. Unlike visible-image super…
Infrared image super-resolutionDOD-SA: Infrared-Visible Decoupled Object Detection with Single-Modality Annotations
Infrared-visible object detection has shown great potential in real-world applications, enabling robust all-day perception by leveraging the complementary information of infrared and visible images. However, existing met…
Object Detection