Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution
Hyperspectral image has become increasingly crucial due to its abundant spectral information. However, It has poor spatial resolution with the limitation of the current imaging mechanism. Nowadays, many convolutional neural networks have been proposed for the hyperspectral image super-resolution problem. However, convolutional neural network (CNN) based methods only consider the local information instead of the global one with the limited kernel size of receptive field in the convolution operation. In this paper, we design a network based on the transformer for fusing the low-resolution hyperspectral images and high-resolution multispectral images to obtain the high-resolution hyperspectral images. Thanks to the representing ability of the transformer, our approach is able to explore the intrinsic relationships of features globally. Furthermore, considering the LR-HSIs hold the main spectral structure, the network focuses on the spatial detail estimation releasing from the burden of reconstructing the whole data. It reduces the mapping space of the proposed network, which enhances the final performance. Various experiments and quality indexes show our approach's superiority compared with other state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Transformers Fusion across Disjoint Samples for Hyperspectral Image Classification
3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes …
Hyperspectral Image Classificationimage-classificationImage ClassificationDiffSpectralNet : Unveiling the Potential of Diffusion Models for Hyperspectral Image Classification
Hyperspectral images (HSI) have become popular for analysing remotely sensed images in multiple domain like agriculture, medical. However, existing models struggle with complex relationships and characteristics of spectr…
ClassificationDenoisingHyperspectral Image Classificationimage-classification+1Hyperspectral Image Classification via Transformer-based Spectral-Spatial Attention Decoupling and Adaptive Gating
Deep neural networks face several challenges in hyperspectral image classification, including high-dimensional data, sparse distribution of ground objects, and spectral redundancy, which often lead to classification over…
ClassificationHyperspectral Image Classificationimage-classificationImage ClassificationUnveiling the potential of diffusion model-based framework with transformer for hyperspectral image classification
Hyperspectral imaging has gained popularity for analysing remotely sensed images in various fields such as agriculture and medical. However, existing models face challenges in dealing with the complex relationships and c…
DenoisingHyperspectral Image Classificationimage-classificationImage ClassificationUnmixing Diffusion for Self-Supervised Hyperspectral Image Denoising
Hyperspectral images (HSIs) have extensive applications in various fields such as medicine agriculture and industry. Nevertheless acquiring high signal-to-noise ratio HSI poses a challenge due to narrow-band spectral…
DenoisingHyperspectral Image DenoisingImage Denoising