paper-with-me

Papers

CodedStereo: Learned Phase Masks for Large Depth-of-field Stereo

2021-04-09 · CVPR 2021 1 · Shiyu Tan, Yicheng Wu, Shoou-I Yu, Ashok Veeraraghavan

Conventional stereo suffers from a fundamental trade-off between imaging volume and signal-to-noise ratio (SNR) -- due to the conflicting impact of aperture size on both these variables. Inspired by the extended depth of field cameras, we propose a novel end-to-end learning-based technique to overcome this limitation, by introducing a phase mask at the aperture plane of the cameras in a stereo imaging system. The phase mask creates a depth-dependent point spread function, allowing us to recover sharp image texture and stereo correspondence over a significantly extended depth of field (EDOF) than conventional stereo. The phase mask pattern, the EDOF image reconstruction, and the stereo disparity estimation are all trained together using an end-to-end learned deep neural network. We perform theoretical analysis and characterization of the proposed approach and show a 6x increase in volume that can be imaged in simulation. We also build an experimental prototype and validate the approach using real-world results acquired using this prototype system.

📄 PDF Abstract BibTeX arXiv:2104.04641

Code (0)

등록된 구현이 없습니다.

Tasks

Disparity EstimationImage ReconstructionStereo Disparity Estimation

Similar Papers 제목 키워드 기반

TiDy-PSFs: Computational Imaging with Time-Averaged Dynamic Point-Spread-Functions

2023-03-30 · ICCV 2023 1 · Sachin Shah, Sakshum Kulshrestha, Christopher A. Metzler

Point-spread-function (PSF) engineering is a powerful computational imaging techniques wherein a custom phase mask is integrated into an optical system to encode additional information into captured images. Used in combi…

Depth EstimationMonocular Depth Estimation

CodedEvents: Optimal Point-Spread-Function Engineering for 3D-Tracking with Event Cameras

2024-06-13 · CVPR 2024 1 · Sachin Shah, Matthew Albert Chan, Haoming Cai, Jingxi Chen 외

Point-spread-function (PSF) engineering is a well-established computational imaging technique that uses phase masks and other optical elements to embed extra information (e.g., depth) into the images captured by conventi…

A Simple Framework for 3D Lensless Imaging with Programmable Masks

2021-08-18 · ICCV 2021 10 · Yucheng Zheng, Yi Hua, Aswin C. Sankaranarayanan, M. Salman Asif

Lensless cameras provide a framework to build thin imaging systems by replacing the lens in a conventional camera with an amplitude or phase mask near the sensor. Existing methods for lensless imaging can recover the dep…

Depth Estimation

End-to-end Learning for Joint Depth and Image Reconstruction from Diffracted Rotation

2022-04-14 · Mazen Mel, Muhammad Siddiqui, Pietro Zanuttigh

Monocular depth estimation is still an open challenge due to the ill-posed nature of the problem at hand. Deep learning based techniques have been extensively studied and proved capable of producing acceptable depth esti…

DeblurringDepth EstimationImage DeblurringImage Reconstruction+1

Learning Monocular Depth Estimation via Selective Distillation of Stereo Knowledge

2022-05-18 · Kyeongseob Song, Kuk-Jin Yoon

Monocular depth estimation has been extensively explored based on deep learning, yet its accuracy and generalization ability still lag far behind the stereo-based methods. To tackle this, a few recent studies have propos…

DecoderDepth EstimationMonocular Depth Estimation