Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systems
Compressive imaging using coded apertures (CA) is a powerful technique that can be used to recover depth, light fields, hyperspectral images and other quantities from a single snapshot. The performance of compressive imaging systems based on CAs mostly depends on two factors: the properties of the mask's attenuation pattern, that we refer to as "codification" and the computational techniques used to recover the quantity of interest from the coded snapshot. In this work, we introduce the idea of using time-varying CAs synchronized with spatially varying pixel shutters. We divide the exposure of a sensor into sub-exposures at the beginning of which the CA mask changes and at which the sensor's pixels are simultaneously and individually switched "on" or "off". This is a practically appealing codification as it does not introduce additional optical components other than the already present CA but uses a change in the pixel shutter that can be easily realized electronically. We show that our proposed time multiplexed coded aperture (TMCA) can be optimized end-to-end and induces better coded snapshots enabling superior reconstructions in two different applications: compressive light field imaging and hyperspectral imaging. We demonstrate both in simulation and on real captures (taken with prototypes we built) that this codification outperforms the state-of-the-art compressive imaging systems by more than 4dB in those applications.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CalibFPA: A Focal Plane Array Imaging System based on Online Deep-Learning Calibration
Compressive focal plane arrays (FPA) enable cost-effective high-resolution (HR) imaging by acquisition of several multiplexed measurements on a low-resolution (LR) sensor. Multiplexed encoding of the visual scene is typi…
Compressive spectral imaging based on hexagonal blue noise coded apertures
Coded aperture snapshot spectral imager (CASSI) is a computational imaging system that acquires a three dimensional (3D) spectral data cube by single or a few two dimensional (2D) measurements. Binary random coded apertu…
Phase-multiplexed optical computing: Reconfiguring a multi-task diffractive optical processor using illumination phase diversity
We report a monochrome multi-task diffractive network architecture that leverages illumination phase multiplexing to dynamically reconfigure its output function and accurately implement a large group of complex-valued li…
Time-Division Multiplexing Light Field Display with Learned Coded Aperture
Conventional stereoscopic displays suffer from vergence-accommodation conflict and cause visual fatigue. Integral-imaging-based displays resolve the problem by directly projecting the sub-aperture views of a light field …
SSIMDemonstration of 3D ISAR Security Imaging at 24GHz with a Sparse MIMO Array
A 3D ISAR security imaging experiment at 24GHz is demonstrated with a sparse MIMO array. The MIMO array is an 8Tx/16Rx linear array to achieve real-aperture imaging along the vertical dimension. It is time-switching mult…
GPUObject Recognition