Hyperspectral Image Super-Resolution With Optimized RGB Guidance
To overcome the limitations of existing hyperspectral cameras on spatial/temporal resolution, fusing a low resolution hyperspectral image (HSI) with a high resolution RGB (or multispectral) image into a high resolution HSI has been prevalent. Previous methods for this fusion task usually employ hand-crafted priors to model the underlying structure of the latent high resolution HSI, and the effect of the camera spectral response (CSR) of the RGB camera on super-resolution accuracy has rarely been investigated. In this paper, we first present a simple and efficient convolutional neural network (CNN) based method for HSI super-resolution in an unsupervised way, without any prior training. Later, we append a CSR optimization layer onto the HSI super-resolution network, either to automatically select the best CSR in a given CSR dataset, or to design the optimal CSR under some physical restrictions. Experimental results show our method outperforms the state-of-the-arts, and the CSR optimization can further boost the accuracy of HSI super-resolution.
Code (1)
Tasks
Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-ResolutionSimilar Papers 제목 키워드 기반
Deep Blind Hyperspectral Image Fusion
Hyperspectral image fusion (HIF) reconstructs high spatial resolution hyperspectral images from low spatial resolution hyperspectral images and high spatial resolution multispectral images. Previous works usually assume …
Super-ResolutionCompensation based Dictionary Transfer for Similar Multispectral Image Spectral Super-resolution
Utilizing a spectral dictionary learned from a couple of similar-scene multi- and hyperspectral image, it is possible to reconstruct a desired hyperspectral image only with one single multispectral image. However, the di…
Spectral Super-ResolutionSuper-ResolutionA Fusion-Guided Inception Network for Hyperspectral Image Super-Resolution
The fusion of low-spatial-resolution hyperspectral images (HSIs) with high-spatial-resolution conventional images (e.g., panchromatic or RGB) has played a significant role in recent advancements in HSI super-resolution. …
Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-ResolutionEfficient Feedback Gate Network for Hyperspectral Image Super-Resolution
Even without auxiliary images, single hyperspectral image super-resolution (SHSR) methods can be designed to improve the spatial resolution of hyperspectral images. However, failing to explore coherence thoroughly along …
Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-ResolutionDACN: Dual-Attention Convolutional Network for Hyperspectral Image Super-Resolution
2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks. However, a key limitation is their reliance on local neighborhoods, which leads to a lack of gl…
Hyperspectral Image Super-ResolutionImage Super-ResolutionL2 RegularizationSuper-Resolution