CodedStereo: Learned Phase Masks for Large Depth-of-field Stereo
Conventional stereo suffers from a fundamental trade-off between imaging volume and signal-to-noise ratio (SNR) -- due to the conflicting impact of aperture size on both these variables. Inspired by the extended depth of field cameras, we propose a novel end-to-end learning-based technique to overcome this limitation, by introducing a phase mask at the aperture plane of the cameras in a stereo imaging system. The phase mask creates a depth-dependent point spread function, allowing us to recover sharp image texture and stereo correspondence over a significantly extended depth of field (EDOF) than conventional stereo. The phase mask pattern, the EDOF image reconstruction, and the stereo disparity estimation are all trained together using an end-to-end learned deep neural network. We perform theoretical analysis and characterization of the proposed approach and show a 6x increase in volume that can be imaged in simulation. We also build an experimental prototype and validate the approach using real-world results acquired using this prototype system.
Code (0)
등록된 구현이 없습니다.
Tasks
Disparity EstimationImage ReconstructionStereo Disparity EstimationSimilar Papers 제목 키워드 기반
TiDy-PSFs: Computational Imaging with Time-Averaged Dynamic Point-Spread-Functions
Point-spread-function (PSF) engineering is a powerful computational imaging techniques wherein a custom phase mask is integrated into an optical system to encode additional information into captured images. Used in combi…
Depth EstimationMonocular Depth EstimationCodedEvents: Optimal Point-Spread-Function Engineering for 3D-Tracking with Event Cameras
Point-spread-function (PSF) engineering is a well-established computational imaging technique that uses phase masks and other optical elements to embed extra information (e.g., depth) into the images captured by conventi…
A Simple Framework for 3D Lensless Imaging with Programmable Masks
Lensless cameras provide a framework to build thin imaging systems by replacing the lens in a conventional camera with an amplitude or phase mask near the sensor. Existing methods for lensless imaging can recover the dep…
Depth EstimationEnd-to-end Learning for Joint Depth and Image Reconstruction from Diffracted Rotation
Monocular depth estimation is still an open challenge due to the ill-posed nature of the problem at hand. Deep learning based techniques have been extensively studied and proved capable of producing acceptable depth esti…
DeblurringDepth EstimationImage DeblurringImage Reconstruction+1Learning Monocular Depth Estimation via Selective Distillation of Stereo Knowledge
Monocular depth estimation has been extensively explored based on deep learning, yet its accuracy and generalization ability still lag far behind the stereo-based methods. To tackle this, a few recent studies have propos…
DecoderDepth EstimationMonocular Depth Estimation