A Modular and Robust Physics-Based Approach for Lensless Image Reconstruction
In this paper, we present a modular approach for reconstructing lensless measurements. It consists of three components: a newly-proposed pre-processor, a physics-based camera inverter to undo the multiplexing of lensless imaging, and a post-processor. The pre- and post-processors address noise and artifacts unique to lensless imaging before and after camera inversion respectively. By training the three components end-to-end, we obtain a 1.9 dB increase in PSNR and a 14% relative improvement in a perceptual image metric (LPIPS) with respect to previously proposed physics-based methods. We also demonstrate how the proposed pre-processor provides more robustness to input noise, and how an auxiliary loss can improve interpretability.
Code (1)
Tasks
Image ReconstructionSimilar Papers 제목 키워드 기반
Towards Robust and Generalizable Lensless Imaging with Modular Learned Reconstruction
Lensless cameras disregard the conventional design that imaging should mimic the human eye. This is done by replacing the lens with a thin mask, and moving image formation to the digital post-processing. State-of-the-art…
Transfer LearningIntegrated Forward-Inverse Network for Lensless Image Reconstruction
Lensless imaging enables compact and versatile computational cameras by replacing bulky optics with thin coded elements. However, reconstruction from the resulting measurements is challenging: large-footprint point-sprea…
Image ReconstructionTowards Physics-informed Cyclic Adversarial Multi-PSF Lensless Imaging
Lensless imaging has emerged as a promising field within inverse imaging, offering compact, cost-effective solutions with the potential to revolutionize the computational camera market. By circumventing traditional optic…
Image ReconstructionSpecificityGuided Lensless Polarization Imaging
Polarization imaging captures the polarization state of light, revealing information invisible to the human eye yet valuable in domains such as biomedical diagnostics, autonomous driving, and remote sensing. However, con…
Autonomous DrivingLet There Be Light: Robust Lensless Imaging Under External Illumination With Deep Learning
Lensless cameras relax the design constraints of traditional cameras by shifting image formation from analog optics to digital post-processing. While new camera designs and applications can be enabled, lensless imaging i…