Decomposition-based and Interference Perception for Infrared and Visible Image Fusion in Complex Scenes
Infrared and visible image fusion has emerged as a prominent research in computer vision. However, little attention has been paid on complex scenes fusion, causing existing techniques to produce sub-optimal results when suffers from real interferences. To fill this gap, we propose a decomposition-based and interference perception image fusion method. Specifically, we classify the pixels of visible image from the degree of scattering of light transmission, based on which we then separate the detail and energy information of the image. This refined decomposition facilitates the proposed model in identifying more interfering pixels that are in complex scenes. To strike a balance between denoising and detail preservation, we propose an adaptive denoising scheme for fusing detail components. Meanwhile, we propose a new weighted fusion rule by considering the distribution of image energy information from the perspective of multiple directions. Extensive experiments in complex scenes fusions cover adverse weathers, noise, blur, overexposure, fire, as well as downstream tasks including semantic segmentation, object detection, salient object detection and depth estimation, consistently indicate the effectiveness and superiority of the proposed method compared with the recent representative methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingDepth EstimationInfrared And Visible Image Fusionobject-detectionObject DetectionSalient Object DetectionSemantic SegmentationSimilar Papers 제목 키워드 기반
Visible and Near Infrared Image Fusion Based on Texture Information
Multi-sensor fusion is widely used in the environment perception system of the autonomous vehicle. It solves the interference caused by environmental changes and makes the whole driving system safer and more reliable. In…
Sensor FusionFSCM: Frequency-Enhanced Spatial-Spectral Coupled Mamba for Infrared Hyperspectral Image Colorization
Thermal infrared imaging is robust to illumination variations and smoke interference, making it important for all-weather perception. However, the lack of natural color and fine texture limits target recognition, human v…
Semantic SegmentationImage ColorizationSimpleFusion: A Simple Fusion Framework for Infrared and Visible Images
Integrating visible and infrared images into one high-quality image, also known as visible and infrared image fusion, is a challenging yet critical task for many downstream vision tasks. Most existing works utilize pretr…
Implicit Multi-Spectral Transformer: An Lightweight and Effective Visible to Infrared Image Translation Model
In the field of computer vision, visible light images often exhibit low contrast in low-light conditions, presenting a significant challenge. While infrared imagery provides a potential solution, its utilization entails …
BenchmarkingImage-to-Image TranslationFD2-Net: Frequency-Driven Feature Decomposition Network for Infrared-Visible Object Detection
Infrared-visible object detection (IVOD) seeks to harness the complementary information in infrared and visible images, thereby enhancing the performance of detectors in complex environments. However, existing methods of…
object-detectionObject Detection