paper-with-me

홈 › Papers

Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution

2021-12-20 · Kaiwei Zhang

Hyperspectral image (HSI) super-resolution without additional auxiliary image remains a constant challenge due to its high-dimensional spectral patterns, where learning an effective spatial and spectral representation is a fundamental issue. Recently, Implicit Neural Representations (INRs) are making strides as a novel and effective representation, especially in the reconstruction task. Therefore, in this work, we propose a novel HSI reconstruction model based on INR which represents HSI by a continuous function mapping a spatial coordinate to its corresponding spectral radiance values. In particular, as a specific implementation of INR, the parameters of parametric model are predicted by a hypernetwork that operates on feature extraction using convolution network. It makes the continuous functions map the spatial coordinates to pixel values in a content-aware manner. Moreover, periodic spatial encoding are deeply integrated with the reconstruction procedure, which makes our model capable of recovering more high frequency details. To verify the efficacy of our model, we conduct experiments on three HSI datasets (CAVE, NUS, and NTIRE2018). Experimental results show that the proposed model can achieve competitive reconstruction performance in comparison with the state-of-the-art methods. In addition, we provide an ablation study on the effect of individual components of our model. We hope this paper could server as a potent reference for future research.

📄 PDF Abstract BibTeX arXiv:2112.10541

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperspectral Image Super-ResolutionImage Super-ResolutionRepresentation LearningSuper-Resolution

Methods 이 논문이 사용한 방법론

HyperNetwork A HyperNetwork is a network that generates weights for a main network. The behavior of the main network is the same with any usual neural network: it learns to map some raw…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution

2026-09-04 · Liqian Yang, Xingchi Chen, Xinfeng Gui, Xiangyong Cao 외 arxiv

Hyperspectral and multispectral image fusion (HMIF) aims to reconstruct a high-resolution hyperspectral image (HR-HSI) by combining the fine spatial details of a high-resolution multispectral image (HR-MSI) with the rich…

Spectral ReconstructionImage Super-ResolutionSemantic Segmentation

Mixed-granularity Implicit Representation for Continuous Hyperspectral Compressive Reconstruction

2025-03-17 · Jianan Li, Huan Chen, Wangcai Zhao, Rui Chen 외

Hyperspectral Images (HSIs) are crucial across numerous fields but are hindered by the long acquisition times associated with traditional spectrometers. The Coded Aperture Snapshot Spectral Imaging (CASSI) system mitigat…

DecoderImage Reconstruction

Bayesian Sparse Representation for Hyperspectral Image Super Resolution

2015-06-01 · CVPR 2015 6 · Naveed Akhtar, Faisal Shafait, Ajmal Mian

Despite the proven efficacy of hyperspectral imaging in many computer vision tasks, its widespread use is hindered by its low spatial resolution, resulting from hardware limitations. We propose a hyperspectral image supe…

Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution

SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolution

2023-09-30 · Gengchen Mai, Ni Lao, Weiwei Sun, Yuchi Ma 외

Existing digital sensors capture images at fixed spatial and spectral resolutions (e.g., RGB, multispectral, and hyperspectral images), and each combination requires bespoke machine learning models. Neural Implicit Funct…

Spectral Super-ResolutionSuper-Resolution

Accurate Spectral Super-resolution from Single RGB Image Using Multi-scale CNN

2018-06-10 · Yiqi Yan, Lei Zhang, Jun Li, Wei Wei 외

Different from traditional hyperspectral super-resolution approaches that focus on improving the spatial resolution, spectral super-resolution aims at producing a high-resolution hyperspectral image from the RGB observat…

Spectral ReconstructionSpectral Super-ResolutionSuper-Resolution