paper-with-me

Papers

HyperColorization: Propagating spatially sparse noisy spectral clues for reconstructing hyperspectral images

2024-03-18 · M. Kerem Aydin, Qi Guo, Emma Alexander

Hyperspectral cameras face challenging spatial-spectral resolution trade-offs and are more affected by shot noise than RGB photos taken over the same total exposure time. Here, we present a colorization algorithm to reconstruct hyperspectral images from a grayscale guide image and spatially sparse spectral clues. We demonstrate that our algorithm generalizes to varying spectral dimensions for hyperspectral images, and show that colorizing in a low-rank space reduces compute time and the impact of shot noise. To enhance robustness, we incorporate guided sampling, edge-aware filtering, and dimensionality estimation techniques. Our method surpasses previous algorithms in various performance metrics, including SSIM, PSNR, GFC, and EMD, which we analyze as metrics for characterizing hyperspectral image quality. Collectively, these findings provide a promising avenue for overcoming the time-space-wavelength resolution trade-off by reconstructing a dense hyperspectral image from samples obtained by whisk or push broom scanners, as well as hybrid spatial-spectral computational imaging systems.

📄 PDF Abstract BibTeX arXiv:2403.11935

Code (1)

nubivlab/hypercolorization 공식 구현

Tasks

ColorizationSSIM

Methods 이 논문이 사용한 방법론

Colorization Colorization is a self-supervision approach that relies on colorization as the pretext task in order to learn image representations.

Similar Papers 제목 키워드 기반

Adaptive Band Selection for Hyperspectral Classification with Spatially Disjoint Evaluation

2026-06-04 · Ikram El-Hajri, Ouassim Karrakchou, Alejandro Mousist arxiv

Hyperspectral band selection methods based on differentiable selectors can be sensitive to initialization and to extracting a final discrete subset, while prescribed band counts limit flexibility. We propose SGBR-HC (Spe…

Deep-learning of Parametric Partial Differential Equations from Sparse and Noisy Data

2020-05-16 · Hao Xu, Dongxiao Zhang, Junsheng Zeng

Data-driven methods have recently made great progress in the discovery of partial differential equations (PDEs) from spatial-temporal data. However, several challenges remain to be solved, including sparse noisy data, in…

Massive Redundancy in Gradient Transport Enables Sparse Online Learning

2026-03-16 · Aur Shalev Merin arxiv

Real-time recurrent learning (RTRL) computes exact online gradients by propagating a Jacobian tensor forward through recurrent dynamics, but at O(n^4) cost per step. Prior work has sought structured approximations (rank-…

Robust fusion algorithms for unsupervised change detection between multi-band optical images - A comprehensive case study

2018-04-09 · Vinicius Ferraris, Nicolas Dobigeon, Marie Chabert

Unsupervised change detection techniques are generally constrained to two multi-band optical images acquired at different times through sensors sharing the same spatial and spectral resolution. This scenario is suitable …

Change Detection

Multiple Hypothesis Testing Framework for Spatial Signals

2021-08-27 · Martin Gölz, Abdelhak M. Zoubir, Visa Koivunen

The problem of identifying regions of spatially interesting, different or adversarial behavior is inherent to many practical applications involving distributed multisensor systems. In this work, we develop a general fram…