Disparity Estimation Using a Quad-Pixel Sensor
A quad-pixel (QP) sensor is increasingly integrated into commercial mobile cameras. The QP sensor has a unit of 2$\times$2 four photodiodes under a single microlens, generating multi-directional phase shifting when out-focus blurs occur. Similar to a dual-pixel (DP) sensor, the phase shifting can be regarded as stereo disparity and utilized for depth estimation. Based on this, we propose a QP disparity estimation network (QPDNet), which exploits abundant QP information by fusing vertical and horizontal stereo-matching correlations for effective disparity estimation. We also present a synthetic pipeline to generate a training dataset from an existing RGB-Depth dataset. Experimental results demonstrate that our QPDNet outperforms state-of-the-art stereo and DP methods. Our code and synthetic dataset are available at https://github.com/Zhuofeng-Wu/QPDNet.
Code (1)
Tasks
Depth EstimationDisparity EstimationStereo MatchingSimilar Papers 제목 키워드 기반
All-directional Disparity Estimation for Real-world QPD Images
Quad Photodiode (QPD) sensors represent an evolution by providing four sub-views, whereas dual-pixel (DP) sensors are limited to two sub-views. In addition to enhancing auto-focus performance, QPD sensors also enable…
AllDisparity EstimationContinuous Cost Aggregation for Dual-Pixel Disparity Extraction
Recent works have shown that depth information can be obtained from Dual-Pixel (DP) sensors. A DP arrangement provides two views in a single shot, thus resembling a stereo image pair with a tiny baseline. However, the di…
Disparity EstimationFormStereo MatchingStereo Hybrid Event-Frame (SHEF) Cameras for 3D Perception
Stereo camera systems play an important role in robotics applications to perceive the 3D world. However, conventional cameras have drawbacks such as low dynamic range, motion blur and latency due to the underlying frame-…
Depth EstimationDisparity EstimationStereo Depth EstimationStereo Disparity Estimation+1Stereo Event Lifetime and Disparity Estimation for Dynamic Vision Sensors
Event-based cameras are biologically inspired sensors that output asynchronous pixel-wise brightness changes in the scene called events. They have a high dynamic range and temporal resolution of a microsecond, opposed to…
Disparity EstimationStereo MatchingStereo Matching HandPassive Snapshot Coded Aperture Dual-Pixel RGB-D Imaging
Passive, compact, single-shot 3D sensing is useful in many application areas such as microscopy, medical imaging, surgical navigation, and autonomous driving where form factor, time, and power constraints can exist. Obta…
Autonomous DrivingDeblurringDepth EstimationDisparity Estimation+1