Efficient Depth Completion Using Learned Bases
In this paper, we propose a new global geometry constraint for depth completion. By assuming depth maps often lay on low dimensional subspaces, a dense depth map can be approximated by a weighted sum of full-resolution principal depth bases. The principal components of depth fields can be learned from natural depth maps. The given sparse depth points are served as a data term to constrain the weighting process. When the input depth points are too sparse, the recovered dense depth maps are often over smoothed. To address this issue, we add a colour-guided auto-regression model as another regularization term. It assumes the reconstructed depth maps should share the same nonlocal similarity in the accompanying colour image. Our colour-guided PCA depth completion method has closed-form solutions, thus can be efficiently solved and is significantly more accurate than PCA only method. Extensive experiments on KITTI and Middlebury datasets demonstrate the superior performance of our proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth CompletionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bayesian Deep Basis Fitting for Depth Completion with Uncertainty
In this work we investigate the problem of uncertainty estimation for image-guided depth completion. We extend Deep Basis Fitting (DBF) for depth completion within a Bayesian evidence framework to provide calibrated per-…
Depth CompletionDepth EstimationDepth PredictionDepth Completion with Multiple Balanced Bases and Confidence for Dense Monocular SLAM
Dense SLAM based on monocular cameras does indeed have immense application value in the field of AR/VR, especially when it is performed on a mobile device. In this paper, we propose a novel method that integrates a light…
Depth CompletionDepth Completion using Piecewise Planar Model
A depth map can be represented by a set of learned bases and can be efficiently solved in a closed form solution. However, one issue with this method is that it may create artifacts when colour boundaries are inconsisten…
Depth CompletionmodelVisual OdometryDepth Completion via Deep Basis Fitting
In this paper we consider the task of image-guided depth completion where our system must infer the depth at every pixel of an input image based on the image content and a sparse set of depth measurements. We propose a n…
Depth CompletionObject Semantics Give Us the Depth We Need: Multi-task Approach to Aerial Depth Completion
Depth completion and object detection are two crucial tasks often used for aerial 3D mapping, path planning, and collision avoidance of Uncrewed Aerial Vehicles (UAVs). Common solutions include using measurements from a …
Collision AvoidanceDecision MakingDepth CompletionMulti-Task Learning+3