Direction Matters: Depth Estimation With a Surface Normal Classifier
In this work we make use of recent advances in data driven classification to improve standard approaches for binocular stereo matching and single view depth estimation. Surface normal direction estimation has become feasible and shown to work reliably on state of the art benchmark datasets. Information about the surface orientation contributes crucial information about the scene geometry in cases where standard approaches struggle. We describe, how the responses of such a classifier can be included in global stereo matching approaches. One of the strengths of our approach is, that we can use the classifier responses for a whole set of directions and let the final optimization decide about the surface orientation. This is important in cases where based on the classifier, multiple different surface orientations seem likely. We evaluate our method on two challenging real-world datasets for the two proposed applications. For the binocular stereo matching we use road scene imagery taken from a car and for the single view depth estimation we use images taken in indoor environments.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationStereo MatchingStereo Matching HandSimilar Papers 제목 키워드 기반
Direction matters: hand pose estimation from local surface normals
We present a hierarchical regression framework for estimating hand joint positions from single depth images based on local surface normals. The hierarchical regression follows the tree structured topology of hand from wr…
Hand Pose EstimationPose EstimationregressionFast, Accurate and Object Boundary-Aware Surface Normal Estimation from Depth Maps
This paper proposes a fast and accurate surface normal estimation method which can be directly used on depth maps (organized point clouds). The surface normal estimation process is formulated as a closed-form expression.…
Surface Normal EstimationGeoNet: Geometric Neural Network for Joint Depth and Surface Normal Estimation
In this paper, we propose Geometric Neural Network (GeoNet) to jointly predict depth and surface normal maps from a single image. Building on top of two-stream CNNs, our GeoNet incorporates geometric relation between dep…
Depth EstimationSurface Normal EstimationIronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertainty
Single image surface normal estimation and depth estimation are closely related problems as the former can be calculated from the latter. However, the surface normals computed from the output of depth estimation methods …
Monocular Depth EstimationPano Popups: Indoor 3D Reconstruction with a Plane-Aware Network
In this work we present a method to train a plane-aware convolutional neural network for dense depth and surface normal estimation as well as plane boundaries from a single indoor $360^\circ$ image. Using our proposed lo…
3D ReconstructionDepth EstimationSurface Normal Estimation