Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture
In this paper we address three different computer vision tasks using a single basic architecture: depth prediction, surface normal estimation, and semantic labeling. We use a multiscale convolutional network that is able to adapt easily to each task using only small modifications, regressing from the input image to the output map directly. Our method progressively refines predictions using a sequence of scales, and captures many image details without any superpixels or low-level segmentation. We achieve state-of-the-art performance on benchmarks for all three tasks.
Code (4)
Tasks
Depth EstimationDepth PredictionMonocular Depth EstimationSuperpixelsSurface Normal EstimationSimilar Papers 제목 키워드 기반
Joint Prediction of Depths, Normals and Surface Curvature from RGB Images using CNNs
Understanding the 3D structure of a scene is of vital importance, when it comes to developing fully autonomous robots. To this end, we present a novel deep learning based framework that estimates depth, surface normals a…
CORE: Co-planarity Regularized Monocular Geometry Estimation with Weak Supervision
The ill-posed nature of monocular 3D geometry (depth map and surface normals) estimation makes it rely mostly on data-driven approaches such as Deep Neural Networks (DNN). However, data acquisition of surface normals…
3D geometryDepth EstimationMulti-Task LearningSurface Normal Estimation+1Floors are Flat: Leveraging Semantics for Real-Time Surface Normal Prediction
We propose 4 insights that help to significantly improve the performance of deep learning models that predict surface normals and semantic labels from a single RGB image. These insights are: (1) denoise the "ground truth…
Semantic SegmentationSurface Normals EstimationvalidGeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimation
In this paper, we propose a geometric neural network with edge-aware refinement (GeoNet++) to jointly predict both depth and surface normal maps from a single image. Building on top of two-stream CNNs, GeoNet++ captures …
3D ReconstructionDepth EstimationDepth PredictionSurface Normal EstimationDeep Surface Normal Estimation on the 2-Sphere with Confidence Guided Semantic Attention
We propose a deep convolutional neural network (CNN) to estimate surface normal from a single color image accompanied with a low-quality depth channel. Unlike most previous works, we predict the normal on the 2-sphere ra…
Missing ValuesSurface Normal Estimation