Deep dual stream residual network with contextual attention for pansharpening of remote sensing images
Pansharpening enhances spatial details of high spectral resolution multispectral images using features of high spatial resolution panchromatic image. There are a number of traditional pansharpening approaches but producing an image exhibiting high spectral and spatial fidelity is still an open problem. Recently, deep learning has been used to produce promising pansharpened images; however, most of these approaches apply similar treatment to both multispectral and panchromatic images by using the same network for feature extraction. In this work, we present present a novel dual attention-based two-stream network. It starts with feature extraction using two separate networks for both images, an encoder with attention mechanism to recalibrate the extracted features. This is followed by fusion of the features forming a compact representation fed into an image reconstruction network to produce a pansharpened image. The experimental results on the Pl\'{e}iades dataset using standard quantitative evaluation metrics and visual inspection demonstrates that the proposed approach performs better than other approaches in terms of pansharpened image quality.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ReconstructionPansharpeningSimilar Papers 제목 키워드 기반
GSPan: A Continuous Gaussian Primitive Representation for Arbitrary-Scale Pansharpening
Pansharpening aims to generate high-resolution multispectral (HRMS) images by fusing low-resolution multispectral (LRMS) and panchromatic (PAN) observations. Most existing deep learning methods treat pansharpening as fix…
Computational EfficiencyResPanDiff: Diffusion Model for Pansharpening by Inferring Residual Inference
The implementation of diffusion-based pansharpening task is predominantly constrained by its slow inference speed, which results from numerous sampling steps. Despite the existing techniques aiming to accelerate sampling…
PansharpeningMulti-Head Attention Residual Unfolded Network for Model-Based Pansharpening
The objective of pansharpening and hypersharpening is to accurately combine a high-resolution panchromatic (PAN) image with a low-resolution multispectral (MS) or hyperspectral (HS) image, respectively. Unfolding fusion …
PansharpeningHyperspectral Pansharpening Based on Improved Deep Image Prior and Residual Reconstruction
Hyperspectral pansharpening aims to synthesize a low-resolution hyperspectral image (LR-HSI) with a registered panchromatic image (PAN) to generate an enhanced HSI with high spectral and spatial resolution. Recently prop…
Image Super-ResolutionPansharpeningSuper-ResolutionCGFformer: Cluster-Guidance Frequency Transformer for Pansharpening
Pansharpening aims to generate high-resolution multispectral (HRMS) images by fusing low-resolution multispectral (LRMS) images with high-resolution panchromatic (PAN) images. However, the current mainstream frequency-ba…