Mixed-granularity Implicit Representation for Continuous Hyperspectral Compressive Reconstruction
Hyperspectral Images (HSIs) are crucial across numerous fields but are hindered by the long acquisition times associated with traditional spectrometers. The Coded Aperture Snapshot Spectral Imaging (CASSI) system mitigates this issue through a compression technique that accelerates the acquisition process. However, reconstructing HSIs from compressed data presents challenges due to fixed spatial and spectral resolution constraints. This study introduces a novel method using implicit neural representation for continuous hyperspectral image reconstruction. We propose the Mixed Granularity Implicit Representation (MGIR) framework, which includes a Hierarchical Spectral-Spatial Implicit Encoder for efficient multi-scale implicit feature extraction. This is complemented by a Mixed-Granularity Local Feature Aggregator that adaptively integrates local features across scales, combined with a decoder that merges coordinate information for precise reconstruction. By leveraging implicit neural representations, the MGIR framework enables reconstruction at any desired spatial-spectral resolution, significantly enhancing the flexibility and adaptability of the CASSI system. Extensive experimental evaluations confirm that our model produces reconstructed images at arbitrary resolutions and matches state-of-the-art methods across varying spectral-spatial compression ratios. The code will be released at https://github.com/chh11/MGIR.
Code (1)
Tasks
DecoderImage ReconstructionSimilar Papers 제목 키워드 기반
Hyperspectral Mixed Noise Removal By L1-Norm-Based Subspace Representation
This article introduces a new hyperspectral image (HSI) denoising method that is able to cope with additive mixed noise, i.e., mixture of Gaussian noise, impulse noise, and stripes, which usually corrupt hyperspectral im…
DenoisingSpectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction
Coded Aperture Snapshot Spectral Imaging (CASSI) reconstruction aims to recover the 3D spatial-spectral signal from 2D measurement. Existing methods for reconstructing Hyperspectral Image (HSI) typically involve learning…
Image ReconstructionSpectral Super-ResolutionSuper-ResolutionImplicit Neural Representation Learning for Hyperspectral Image Super-Resolution
Hyperspectral image (HSI) super-resolution without additional auxiliary image remains a constant challenge due to its high-dimensional spectral patterns, where learning an effective spatial and spectral representation is…
Hyperspectral Image Super-ResolutionImage Super-ResolutionRepresentation LearningSuper-ResolutionHyperspectral Mixed Noise Removal via Subspace Representation and Weighted Low-rank Tensor Regularization
Recently, the low-rank property of different components extracted from the image has been considered in man hyperspectral image denoising methods. However, these methods usually unfold the 3D tensor to 2D matrix or 1D ve…
DenoisingHyperspectral Image DenoisingImage DenoisingLearning Hyperspectral Feature Extraction and Classification with ResNeXt Network
The Hyperspectral image (HSI) classification is a standard remote sensing task, in which each image pixel is given a label indicating the physical land-cover on the earth's surface. The achievements of image semantic seg…
ClassificationGeneral ClassificationHyperspectral Image Classificationimage-classification+2