paper-with-me

Papers

SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Network

2021-07-03 · Nazmul Karim, Nazanin Rahnavard

Single-pixel imaging is a novel imaging scheme that has gained popularity due to its huge computational gain and potential for a low-cost alternative to imaging beyond the visible spectrum. The traditional reconstruction methods struggle to produce a clear recovery when one limits the number of illumination patterns from a spatial light modulator. As a remedy, several deep-learning-based solutions have been proposed which lack good generalization ability due to the architectural setup and loss functions. In this paper, we propose a generative adversarial network-based reconstruction framework for single-pixel imaging, referred to as SPI-GAN. Our method can reconstruct images with 17.92 dB PSNR and 0.487 SSIM, even if the sampling ratio drops to 5%. This facilitates much faster reconstruction making our method suitable for single-pixel video. Furthermore, our ResNet-like architecture for the generator leads to useful representation learning that allows us to reconstruct completely unseen objects. The experimental results demonstrate that SPI-GAN achieves significant performance gain, e.g. near 3dB PSNR gain, over the current state-of-the-art method.

📄 PDF Abstract BibTeX arXiv:2107.01330

Code (2)

nazmul-karim170/SPI-GAN-for-Single-Pixel-Camera 공식 구현 pytorch
nazmul-karim170/FIP-Fisher-Backdoor-Removal pytorch

Tasks

Generative Adversarial NetworkRepresentation LearningSSIM

Similar Papers 제목 키워드 기반

Generative adversarial network based single pixel imaging

2021-07-11 · Ming Zhao, Fengqiang Li, Fengyue Huo, Zhiming Tian

Single pixel imaging can reconstruct two-dimensional images of a scene with only a single-pixel detector. It has been widely used for imaging in non-visible bandwidth (e.g., near-infrared and X-ray) where focal-plane arr…

Generative Adversarial Network

Physics-driven generative adversarial networks empower single-pixel infrared hyperspectral imaging

2023-11-22 · Dong-Yin Wang, Shu-Hang Bie, Xi-Hao Chen, Wen-Kai Yu

A physics-driven generative adversarial network (GAN) was established here for single-pixel hyperspectral imaging (HSI) in the infrared spectrum, to eliminate the extensive data training work required by traditional data…

compressed sensingGenerative Adversarial Network

High-throughput, high-resolution registration-free generated adversarial network microscopy

2018-01-07 · Hao Zhang, Xinlin Xie, Chunyu Fang, Yicong Yang 외

We combine generative adversarial network (GAN) with light microscopy to achieve deep learning super-resolution under a large field of view (FOV). By appropriately adopting prior microscopy data in an adversarial trainin…

Generative Adversarial NetworkImage RegistrationImage Super-ResolutionSuper-Resolution+1

Single-pixel imaging based on deep learning

2023-10-25 · Kai Song, Yaoxing Bian, Ku Wu, Hongrui Liu 외

Single-pixel imaging can collect images at the wavelengths outside the reach of conventional focal plane array detectors. However, the limited image quality and lengthy computational times for iterative reconstruction st…

Deep LearningSuper-Resolution

Rapid Single Image-Based DTM Estimation from ExoMars TGO CaSSIS Images Using Generative Adversarial U-Nets

2021-07-21 · Remote Sensing 2021 7 · Yu Tao, Siting Xiong, Susan J. Conway, Jan-Peter Muller 외

The lack of adequate stereo coverage and where available, lengthy processing time, various artefacts, and unsatisfactory quality and complexity of automating the selection of the best set of processing parameters, have l…