paper-with-me

Papers

SSPFusion: A Semantic Structure-Preserving Approach for Infrared and Visible Image Fusion

2023-09-26 · Qiao Yang, Yu Zhang, Jian Zhang, Zijing Zhao, Shunli Zhang, Jinqiao Wang, Junzhe Chen

Most existing learning-based infrared and visible image fusion (IVIF) methods exhibit massive redundant information in the fusion images, i.e., yielding edge-blurring effect or unrecognizable for object detectors. To alleviate these issues, we propose a semantic structure-preserving approach for IVIF, namely SSPFusion. At first, we design a Structural Feature Extractor (SFE) to extract the structural features of infrared and visible images. Then, we introduce a multi-scale Structure-Preserving Fusion (SPF) module to fuse the structural features of infrared and visible images, while maintaining the consistency of semantic structures between the fusion and source images. Owing to these two effective modules, our method is able to generate high-quality fusion images from pairs of infrared and visible images, which can boost the performance of downstream computer-vision tasks. Experimental results on three benchmarks demonstrate that our method outperforms eight state-of-the-art image fusion methods in terms of both qualitative and quantitative evaluations. The code for our method, along with additional comparison results, will be made available at: https://github.com/QiaoYang-CV/SSPFUSION.

📄 PDF Abstract BibTeX arXiv:2309.14745

Code (0)

등록된 구현이 없습니다.

Tasks

Infrared And Visible Image Fusion

Similar Papers 제목 키워드 기반

Near-Infrared Coloring via a Contrast-Preserving Mapping Model

2016-10-03 · Chang-Hwan Son, Xiao-Ping Zhang

Near-infrared gray images captured together with corresponding visible color images have recently proven useful for image restoration and classification. This paper introduces a new coloring method to add colors to near-…

DenoisingImage Restoration

Visible and Near Infrared Image Fusion Based on Texture Information

2022-07-22 · Guanyu Zhang, Beichen Sun, Yuehan Qi, Yang Liu

Multi-sensor fusion is widely used in the environment perception system of the autonomous vehicle. It solves the interference caused by environmental changes and makes the whole driving system safer and more reliable. In…

Sensor Fusion

CycleTrans: Learning Neutral yet Discriminative Features for Visible-Infrared Person Re-Identification

2022-08-21 · Qiong Wu, Jiaer Xia, Pingyang Dai, Yiyi Zhou 외

Visible-infrared person re-identification (VI-ReID) is a task of matching the same individuals across the visible and infrared modalities. Its main challenge lies in the modality gap caused by cameras operating on differ…

Person Re-Identification

UNIV: Unified Foundation Model for Infrared and Visible Modalities

2025-09-19 · Fangyuan Mao, Shuo Wang, Jilin Mei, Shun Lu 외 arxiv

Joint RGB-infrared perception is essential for achieving robustness under diverse weather and illumination conditions. Although foundation models excel within single modalities, they suffer from substantial cross-modal d…

Semantic SegmentationContrastive LearningSemantic Similarity

TC-PDM: Temporally Consistent Patch Diffusion Models for Infrared-to-Visible Video Translation

2024-08-26 · Anh-Dzung Doan, Vu Minh Hieu Phan, Surabhi Gupta, Markus Wagner 외

Infrared imaging offers resilience against changing lighting conditions by capturing object temperatures. Yet, in few scenarios, its lack of visual details compared to daytime visible images, poses a significant challeng…

Denoisingobject-detectionObject DetectionTranslation