paper-with-me

홈 › Papers

Optimal HDR and Depth from Dual Cameras

2020-03-12 · Pradyumna Chari, Anil Kumar Vadathya, Kaushik Mitra

Dual camera systems have assisted in the proliferation of various applications, such as optical zoom, low-light imaging and High Dynamic Range (HDR) imaging. In this work, we explore an optimal method for capturing the scene HDR and disparity map using dual camera setups. Hasinoff et al. (2010) have developed a noise optimal framework for HDR capture from a single camera. We generalize this to the dual camera set-up for estimating both HDR and disparity map. It may seem that dual camera systems can capture HDR in a shorter time. However, disparity estimation is a necessary step, which requires overlap among the images captured by the two cameras. This may lead to an increase in the capture time. To address this conflicting requirement, we propose a novel framework to find the optimal exposure and ISO sequence by minimizing the capture time under the constraints of an upper bound on the disparity error and a lower bound on the per-exposure SNR. We show that the resulting optimization problem is non-convex in general and propose an appropriate initialization technique. To obtain the HDR and disparity map from the optimal capture sequence, we propose a pipeline which alternates between estimating the camera ICRFs and the scene disparity map. We demonstrate that our optimal capture sequence leads to better results than other possible capture sequences. Our results are also close to those obtained by capturing the full stereo stack spanning the entire dynamic range. Finally, we present for the first time a stereo HDR dataset consisting of dense ISO and exposure stack captured from a smartphone dual camera. The dataset consists of 6 scenes, with an average of 142 exposure-ISO image sequence per scene.

📄 PDF Abstract BibTeX arXiv:2003.05907

Code (0)

등록된 구현이 없습니다.

Tasks

Disparity Estimation

Similar Papers 제목 키워드 기반

Du$^2$Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixels

2020-03-31 · Yinda Zhang, Neal Wadhwa, Sergio Orts-Escolano, Christian Häne 외

Computational stereo has reached a high level of accuracy, but degrades in the presence of occlusions, repeated textures, and correspondence errors along edges. We present a novel approach based on neural networks for de…

Depth EstimationStereo Matching

Du²Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixels

2020-08-01 · ECCV 2020 8 · Yinda Zhang, Neal Wadhwa, Sergio Orts-Escolano, Christian Häne 외

Computational stereo has reached a high level of accuracy, but degrades in the presence of occlusions, repeated textures, and correspondence errors along edges. We present a novel approach based on neural networks for de…

Depth EstimationStereo Matching

DSR: Direct Self-rectification for Uncalibrated Dual-lens Cameras

2018-09-26 · Ruichao Xiao, Wenxiu Sun, Jiahao Pang, Qiong Yan 외

With the developments of dual-lens camera modules,depth information representing the third dimension of thecaptured scenes becomes available for smartphones. It isestimated by stereo matching algorithms, taking as input …

Stereo MatchingStereo Matching Hand

Unsupervised Visible-light Images Guided Cross-Spectrum Depth Estimation from Dual-Modality Cameras

2022-04-30 · Yubin Guo, Haobo Jiang, Xinlei Qi, Jin Xie 외

Cross-spectrum depth estimation aims to provide a depth map in all illumination conditions with a pair of dual-spectrum images. It is valuable for autonomous vehicle applications when the vehicle is equipped with two cam…

Depth Estimation

Depth from Dual Differential Defocus and Stereo Consensus

2026-06-01 · Junjie Luo, Wei Xu, Dylan Chu, Emma Alexander 외 arxiv

We introduce D^3S Consensus, a physics-based, closed-form algorithm that unifies depth-from-defocus (DfD) and stereo to achieve highly accurate depth estimation throughout an extended working range beyond the depth-of-fi…

Depth Estimation