paper-with-me

홈 › Papers

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

2021-01-12 · Yongsheng Zang, Dongming Zhou, Changcheng Wang, Rencan Nie, Yanbu Guo

Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose some source image details or results in artifacts. Inspired by the image reconstruction techniques based on deep learning, we propose a multi-focus image fusion network framework without any post-processing to solve these problems in the end-to-end and supervised learning way. To sufficiently train the fusion model, we have generated a large-scale multi-focus image dataset with ground-truth fusion images. What's more, to obtain a more informative fusion image, we further designed a novel fusion strategy based on unity fusion attention, which is composed of a channel attention module and a spatial attention module. Specifically, the proposed fusion approach mainly comprises three key components: feature extraction, feature fusion and image reconstruction. We firstly utilize seven convolutional blocks to extract the image features from source images. Then, the extracted convolutional features are fused by the proposed fusion strategy in the feature fusion layer. Finally, the fused image features are reconstructed by four convolutional blocks. Experimental results demonstrate that the proposed approach for multi-focus image fusion achieves remarkable fusion performance compared to 19 state-of-the-art fusion methods.

📄 PDF Abstract BibTeX arXiv:2101.04506

Code (0)

등록된 구현이 없습니다.

Tasks

Image ReconstructionMulti Focus Image FusionUnity

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Average Pooling 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Sigmoid Activation 설명 없음
How do i ask a question at Expedia?*AskExpertService To ask a question on Expedia, you can utilize their Help Center +1-888-829-0881, call customer service, use live chat, or reach out via social media. You can also find answers to…

Similar Papers 제목 키워드 기반

Multi-Modal Hybrid Learning and Sequential Training for RGB-T Saliency Detection

2023-09-13 · Guangyu Ren, Jitesh Joshi, Youngjun Cho

RGB-T saliency detection has emerged as an important computer vision task, identifying conspicuous objects in challenging scenes such as dark environments. However, existing methods neglect the characteristics of cross-m…

Saliency Detection

Unsupervised Deep Multi-focus Image Fusion

2018-06-19 · Xiang Yan, Syed Zulqarnain Gilani, Hanlin Qin, Ajmal Mian

Convolutional neural networks have recently been used for multi-focus image fusion. However, due to the lack of labeled data for supervised training of such networks, existing methods have resorted to adding Gaussian blu…

Multi Focus Image FusionSSIM

Multi-scale convolutional neural network for multi-focus image fusion

2019-03-05 · Hafiz Tayyab Mustafa, Jie Yang, Masoumeh Zareapoor

In this study, we present new deep learning (DL) method for fusing multi-focus images. Current multi-focus image fusion (MFIF) approaches based on DL methods mainly treat MFIF as a classification task. These methods use …

Multi Focus Image FusionSSIM

SESF-Fuse: An Unsupervised Deep Model for Multi-Focus Image Fusion

2019-08-05 · Boyuan Ma, Xiaojuan Ban, Haiyou Huang, Yu Zhu

In this work, we propose a novel unsupervised deep learning model to address multi-focus image fusion problem. First, we train an encoder-decoder network in unsupervised manner to acquire deep feature of input images. An…

DecoderMulti Focus Image Fusion

HYRR: Hybrid Infused Reranking for Passage Retrieval

2022-12-20 · Jing Lu, Keith Hall, Ji Ma, Jianmo Ni

We present Hybrid Infused Reranking for Passages Retrieval (HYRR), a framework for training rerankers based on a hybrid of BM25 and neural retrieval models. Retrievers based on hybrid models have been shown to outperform…

Passage RetrievalRerankingRetrieval