Hierarchical Surface Prediction for 3D Object Reconstruction
Recently, Convolutional Neural Networks have shown promising results for 3D geometry prediction. They can make predictions from very little input data such as a single color image. A major limitation of such approaches is that they only predict a coarse resolution voxel grid, which does not capture the surface of the objects well. We propose a general framework, called hierarchical surface prediction (HSP), which facilitates prediction of high resolution voxel grids. The main insight is that it is sufficient to predict high resolution voxels around the predicted surfaces. The exterior and interior of the objects can be represented with coarse resolution voxels. Our approach is not dependent on a specific input type. We show results for geometry prediction from color images, depth images and shape completion from partial voxel grids. Our analysis shows that our high resolution predictions are more accurate than low resolution predictions.
Code (1)
Tasks
3D geometry3D Geometry Prediction3D Object ReconstructionObjectObject ReconstructionPredictionSimilar Papers 제목 키워드 기반
NeuDA: Neural Deformable Anchor for High-Fidelity Implicit Surface Reconstruction
This paper studies implicit surface reconstruction leveraging differentiable ray casting. Previous works such as IDR and NeuS overlook the spatial context in 3D space when predicting and rendering the surface, thereby ma…
Surface ReconstructionVocal Bursts Intensity PredictionModeling 3D Surface Manifolds with a Locally Conditioned Atlas
Recently proposed 3D object reconstruction methods represent a mesh with an atlas - a set of planar patches approximating the surface. However, their application in a real-world scenario is limited since the surfaces of …
3D Object ReconstructionObjectObject ReconstructionRfD-Net: Point Scene Understanding by Semantic Instance Reconstruction
Semantic scene understanding from point clouds is particularly challenging as the points reflect only a sparse set of the underlying 3D geometry. Previous works often convert point cloud into regular grids (e.g. voxels o…
3D geometryObjectobject-detectionObject Detection+3HIVE: HIerarchical Volume Encoding for Neural Implicit Surface Reconstruction
Neural implicit surface reconstruction has become a new trend in reconstructing a detailed 3D shape from images. In previous methods, however, the 3D scene is only encoded by the MLPs which do not have an explicit 3D str…
Surface ReconstructionJoint Camera Clustering and Surface Segmentation for Large-Scale Multi-View Stereo
In this paper, we propose an optimal decomposition approach to large-scale multi-view stereo from an initial sparse reconstruction. The success of the approach depends on the introduction of surface-segmentation-based ca…
Clusteringparameter estimationSegmentation