UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion
Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose some source image details or results in artifacts. Inspired by the image reconstruction techniques based on deep learning, we propose a multi-focus image fusion network framework without any post-processing to solve these problems in the end-to-end and supervised learning way. To sufficiently train the fusion model, we have generated a large-scale multi-focus image dataset with ground-truth fusion images. What's more, to obtain a more informative fusion image, we further designed a novel fusion strategy based on unity fusion attention, which is composed of a channel attention module and a spatial attention module. Specifically, the proposed fusion approach mainly comprises three key components: feature extraction, feature fusion and image reconstruction. We firstly utilize seven convolutional blocks to extract the image features from source images. Then, the extracted convolutional features are fused by the proposed fusion strategy in the feature fusion layer. Finally, the fused image features are reconstructed by four convolutional blocks. Experimental results demonstrate that the proposed approach for multi-focus image fusion achieves remarkable fusion performance compared to 19 state-of-the-art fusion methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ReconstructionMulti Focus Image FusionUnityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-Modal Hybrid Learning and Sequential Training for RGB-T Saliency Detection
RGB-T saliency detection has emerged as an important computer vision task, identifying conspicuous objects in challenging scenes such as dark environments. However, existing methods neglect the characteristics of cross-m…
Saliency DetectionUnsupervised Deep Multi-focus Image Fusion
Convolutional neural networks have recently been used for multi-focus image fusion. However, due to the lack of labeled data for supervised training of such networks, existing methods have resorted to adding Gaussian blu…
Multi Focus Image FusionSSIMMulti-scale convolutional neural network for multi-focus image fusion
In this study, we present new deep learning (DL) method for fusing multi-focus images. Current multi-focus image fusion (MFIF) approaches based on DL methods mainly treat MFIF as a classification task. These methods use …
Multi Focus Image FusionSSIMSESF-Fuse: An Unsupervised Deep Model for Multi-Focus Image Fusion
In this work, we propose a novel unsupervised deep learning model to address multi-focus image fusion problem. First, we train an encoder-decoder network in unsupervised manner to acquire deep feature of input images. An…
DecoderMulti Focus Image FusionHYRR: Hybrid Infused Reranking for Passage Retrieval
We present Hybrid Infused Reranking for Passages Retrieval (HYRR), a framework for training rerankers based on a hybrid of BM25 and neural retrieval models. Retrievers based on hybrid models have been shown to outperform…
Passage RetrievalRerankingRetrieval