paper-with-me

Papers

Physics-Based Learned Diffuser for Single-shot 3D Imaging

2021-10-19 · NeurIPS Workshop Deep_Invers 2021 12 · Eric Markley, Fanglin Linda Liu, Michael Kellman, Nick Antipa, Laura Waller

A diffuser in the Fourier space of an imaging system can encode 3D fluorescence intensity information in a single-shot 2D measurement, which is then recovered by a compressed sensing algorithm. Typically, the diffusers used in such systems are either off-the-shelf, heuristically designed, or merit function driven. In this work we use a differentiable forward model of single-shot 3D microscopy in conjunction with an invertible and differentiable reconstruction algorithm, ISTA-Net+, to jointly optimize both the diffuser surface shape and the reconstruction parameters. By choosing a differentiable and invertible reconstruction method, we enable the use of memory-efficient backpropagation to trade off storage with a reasonable increase in compute time, in order to fit an unrolled network containing a large-scale 3D volume into a single GPU’s memory. We validate our method on 2D and 3D single-shot imaging, where our learned diffuser demonstrates improved reconstruction quality compared to previous heuristic designs.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

compressed sensing

Similar Papers 제목 키워드 기반

Temporal compressive edge imaging enabled by a lensless diffuser camera

2023-09-13 · Ze Zheng, Baolei Liu, Jiaqi Song, Lei Ding 외

Lensless imagers based on diffusers or encoding masks enable high-dimensional imaging from a single shot measurement and have been applied in various applications. However, to further extract image information such as ed…

Edge Detection

Fourier DiffuserScope: Single-shot 3D Fourier light field microscopy with a diffuser

2020-09-16

Light field microscopy (LFM) uses a microlens array (MLA) near the sensor plane of a microscope to achieve single-shot 3D imaging of a sample without any moving parts. Unfortunately, the 3D capability of LFM comes with a…

Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers

2022-05-01 · Yuhang Li, Yi Luo, Bijie Bai, Aydogan Ozcan

Imaging through diffusive media is a challenging problem, where the existing solutions heavily rely on digital computers to reconstruct distorted images. We provide a detailed analysis of a computer-free, all-optical ima…

Autonomous DrivingImage Reconstruction

DiffuserCam: Lensless Single-exposure 3D Imaging

2017-10-05 · Nick Antipa, Grace Kuo, Reinhard Heckel, Ben Mildenhall 외

We demonstrate a compact and easy-to-build computational camera for single-shot 3D imaging. Our lensless system consists solely of a diffuser placed in front of a standard image sensor. Every point within the volumetric …

compressed sensing

A Lensless Polarization Camera

2026-03-17 · Noa Kraicer, Shay Elmalem, Erez Yosef, Hani Barhum 외 arxiv

Polarization imaging is a technique that creates a pixel map of the polarization state in a scene. Although invisible to the human eye, polarization can assist various sensing and computer vision tasks. Existing polariza…