Depth Reconstruction from Sparse Samples: Representation, Algorithm, and Sampling
The rapid development of 3D technology and computer vision applications have motivated a thrust of methodologies for depth acquisition and estimation. However, most existing hardware and software methods have limited performance due to poor depth precision, low resolution and high computational cost. In this paper, we present a computationally efficient method to recover dense depth maps from sparse measurements. We make three contributions. First, we provide empirical evidence that depth maps can be encoded much more sparsely than natural images by using common dictionaries such as wavelets and contourlets. We also show that a combined wavelet-contourlet dictionary achieves better performance than using either dictionary alone. Second, we propose an alternating direction method of multipliers (ADMM) to achieve fast reconstruction. A multi-scale warm start procedure is proposed to speed up the convergence. Third, we propose a two-stage randomized sampling scheme to optimally choose the sampling locations, thus maximizing the reconstruction performance for any given sampling budget. Experimental results show that the proposed method produces high quality dense depth estimates, and is robust to noisy measurements. Applications to real data in stereo matching are demonstrated.
Code (0)
등록된 구현이 없습니다.
Tasks
Stereo MatchingStereo Matching HandMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sparse Depth Completion with Semantic Mesh Deformation Optimization
Sparse depth measurements are widely available in many applications such as augmented reality, visual inertial odometry and robots equipped with low cost depth sensors. Although such sparse depth samples work well for ce…
3D Object Recognition3D ReconstructionAutonomous DrivingDepth Completion+3Geometry-aware Two-scale PIFu Representation for Human Reconstruction
Although PIFu-based 3D human reconstruction methods are popular, the quality of recovered details is still unsatisfactory. In a sparse (e.g., 3 RGBD sensors) capture setting, the depth noise is typically amplified in the…
3D Human Reconstruction3D ReconstructionDenoisingMulti-Task Learning+1Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image
We consider the problem of dense depth prediction from a sparse set of depth measurements and a single RGB image. Since depth estimation from monocular images alone is inherently ambiguous and unreliable, to attain a hig…
Depth EstimationDepth PredictionPredictionSimultaneous Localization and Mapping+1From Depth What Can You See? Depth Completion via Auxiliary Image Reconstruction
Depth completion recovers dense depth from sparse measurements, e.g., LiDAR. Existing depth-only methods use sparse depth as the only input. However, these methods may fail to recover semantics consistent boundaries, or …
Depth CompletionImage ReconstructionSubsampled terahertz data reconstruction based on spatio-temporal dictionary learning
In this paper, the problem of terahertz pulsed imaging and reconstruction is addressed. It is assumed that an incomplete (subsampled) three dimensional THz data set has been acquired and the aim is to recover all missing…
Dictionary Learning