paper-with-me

Papers

Exploiting Frequency Correlation for Hyperspectral Image Reconstruction

2024-06-02 · Muge Yan, Lizhi Wang, Lin Zhu, Hua Huang

Deep priors have emerged as potent methods in hyperspectral image (HSI) reconstruction. While most methods emphasize space-domain learning using image space priors like non-local similarity, frequency-domain learning using image frequency priors remains neglected, limiting the reconstruction capability of networks. In this paper, we first propose a Hyperspectral Frequency Correlation (HFC) prior rooted in in-depth statistical frequency analyses of existent HSI datasets. Leveraging the HFC prior, we subsequently establish the frequency domain learning composed of a Spectral-wise self-Attention of Frequency (SAF) and a Spectral-spatial Interaction of Frequency (SIF) targeting low-frequency and high-frequency components, respectively. The outputs of SAF and SIF are adaptively merged by a learnable gating filter, thus achieving a thorough exploitation of image frequency priors. Integrating the frequency domain learning and the existing space domain learning, we finally develop the Correlation-driven Mixing Domains Transformer (CMDT) for HSI reconstruction. Extensive experiments highlight that our method surpasses various state-of-the-art (SOTA) methods in reconstruction quality and computational efficiency.

📄 PDF Abstract BibTeX arXiv:2406.00683

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyImage Reconstruction

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Synthetic Hyperspectral Array Video Database with Applications to Cross-Spectral Reconstruction and Hyperspectral Video Coding

2023-01-18 · Frank Sippel, Jürgen Seiler, André Kaup

In this paper, a synthetic hyperspectral video database is introduced. Since it is impossible to record ground truth hyperspectral videos, this database offers the possibility to leverage the evaluation of algorithms in …

DiversityImage ReconstructionSpectral Reconstruction

Snapshot Hyperspectral Imaging Based on Weighted High-order Singular Value Regularization

2021-01-22 · Niankai Cheng, Hua Huang, Lei Zhang, Lizhi Wang

Snapshot hyperspectral imaging can capture the 3D hyperspectral image (HSI) with a single 2D measurement and has attracted increasing attention recently. Recovering the underlying HSI from the compressive measurement is …

Vocal Bursts Intensity Prediction

Snapshot Hyperspectral Light Field Imaging

2017-07-01 · CVPR 2017 7 · Zhiwei Xiong, Lizhi Wang, Huiqun Li, Dong Liu 외

This paper presents the first snapshot hyperspectral light field imager in practice. Specifically, we design a novel hybrid camera system to obtain two complementary measurements that sample the angular and spectral dime…

Physics-Informed Untrained Learning for RGB-Guided Superresolution Single-Pixel Hyperspectral Imaging

2026-04-04 · Hao Zhang, Bilige Xu, Lichen Wei, Xu Ma 외 arxiv

Single-pixel imaging (SPI) offers a cost-effective route to hyperspectral acquisition but struggles to recover high-fidelity spatial and spectral details under extremely low sampling rates, a severely ill-posed inverse p…

Hy-demosaicing: Hyperspectral blind reconstruction from spectral subsampling

2021-08-13 · IEEE Transactions on Geoscience and Remote Sensing 2021 8 · Lina Zhuang, Michael K. Ng, Xiyou Fu, Jose M Bioucas-Dias

This article proposes a smart hyperspectral sensing strategy, implemented in the spectral domain, conceived for spaceborne sensor systems, where physical space, storage resources, and communication bandwidth are extremel…

Demosaicking