paper-with-me

홈 › Papers

HSR-Diff: Hyperspectral Image Super-Resolution via Conditional Diffusion Models

2023-01-01 · ICCV 2023 1 · Chanyue Wu, Dong Wang, Yunpeng Bai, Hanyu Mao, Ying Li, Qiang Shen

Despite the proven significance of hyperspectral images (HSIs) in performing various computer vision tasks, its potential is adversely affected by the low-resolution (LR) property in the spatial domain, resulting from multiple physical factors. Inspired by recent advancements in deep generative models, we propose an HSI Super-resolution (SR) approach with Conditional Diffusion Models (HSR-Diff) that merges a high-resolution (HR) multispectral image (MSI) with the corresponding LR-HSI. HSR-Diff generates an HR-HSI via repeated refinement, in which the HR-HSI is initialized with pure Gaussian noise and iteratively refined. At each iteration, the noise is removed with a Conditional Denoising Transformer (CDFormer) that is trained on denoising at different noise levels, conditioned on the hierarchical feature maps of HR-MSI and LR-HSI. In addition, a progressive learning strategy is employed to exploit the global information of full-resolution images. Systematic experiments have been conducted on four public datasets, demonstrating that HSR-Diff outperforms state-of-the-art methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingHyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models

2023-06-21 · Chanyue Wu, Dong Wang, Hanyu Mao, Ying Li

Despite the proven significance of hyperspectral images (HSIs) in performing various computer vision tasks, its potential is adversely affected by the low-resolution (LR) property in the spatial domain, resulting from mu…

DenoisingImage Super-ResolutionSuper-Resolution

Aerial Spectral Super-Resolution using Conditional Adversarial Networks

2017-12-23 · Aneesh Rangnekar, Nilay Mokashi, Emmett Ientilucci, Christopher Kanan 외

Inferring spectral signatures from ground based natural images has acquired a lot of interest in applied deep learning. In contrast to the spectra of ground based images, aerial spectral images have low spatial resolutio…

Spectral Super-ResolutionSuper-Resolution

Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model

2023-07-07 · Shuaikai Shi, Lijun Zhang, Jie Chen

Hyperspectral images (HSI) have a large amount of spectral information reflecting the characteristics of matter, while their spatial resolution is low due to the limitations of imaging technology. Complementary to this a…

Denoising

Hyperspectral Super-Resolution by Coupled Spectral Unmixing

2015-12-01 · ICCV 2015 12 · Charis Lanaras, Emmanuel Baltsavias, Konrad Schindler

Hyperspectral cameras capture images with many narrow spectral channels, which densely sample the electromagnetic spectrum. The detailed spectral resolution is useful for many image analysis problems, but it comes at the…

Super-Resolution

Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery

2020-05-18 · Junjun Jiang, He Sun, Xian-Ming Liu, Jiayi Ma

Recently, single gray/RGB image super-resolution reconstruction task has been extensively studied and made significant progress by leveraging the advanced machine learning techniques based on deep convolutional neural ne…

Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution