Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction
Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in attempt to predict 3D shapes, where information is rich only on the surfaces. In this paper, we propose a novel 3D generative modeling framework to efficiently generate object shapes in the form of dense point clouds. We use 2D convolutional operations to predict the 3D structure from multiple viewpoints and jointly apply geometric reasoning with 2D projection optimization. We introduce the pseudo-renderer, a differentiable module to approximate the true rendering operation, to synthesize novel depth maps for optimization. Experimental results for single-image 3D object reconstruction tasks show that we outperforms state-of-the-art methods in terms of shape similarity and prediction density.
Code (3)
Tasks
3D Object ReconstructionObjectObject ReconstructionPoint Cloud GenerationSimilar Papers 제목 키워드 기반
Dense 3D Point Cloud Reconstruction Using a Deep Pyramid Network
Reconstructing a high-resolution 3D model of an object is a challenging task in computer vision. Designing scalable and light-weight architectures is crucial while addressing this problem. Existing point-cloud based reco…
3D Point Cloud ReconstructionPoint cloud reconstructionSparse2Dense: Learning to Densify 3D Features for 3D Object Detection
LiDAR-produced point clouds are the major source for most state-of-the-art 3D object detectors. Yet, small, distant, and incomplete objects with sparse or few points are often hard to detect. We present Sparse2Dense, a n…
3D Object DetectionDomain Adaptationobject-detectionObject Detection+1HORT: Monocular Hand-held Objects Reconstruction with Transformers
Reconstructing hand-held objects in 3D from monocular images remains a significant challenge in computer vision. Most existing approaches rely on implicit 3D representations, which produce overly smooth reconstructions a…
DenoisingSparse2DGS: Sparse-View Surface Reconstruction using 2D Gaussian Splatting with Dense Point Cloud
Gaussian Splatting (GS) has gained attention as a fast and effective method for novel view synthesis. It has also been applied to 3D reconstruction using multi-view images and can achieve fast and accurate 3D reconstruct…
3D ReconstructionNovel View SynthesisSurface ReconstructionDeepPoint: A Deep Learning Model for 3D Reconstruction in Point Clouds via mmWave Radar
Recent research has shown that mmWave radar sensing is effective for object detection in low visibility environments, which makes it an ideal technique in autonomous navigation systems such as autonomous vehicles. Howeve…
3D ReconstructionAutonomous NavigationAutonomous VehiclesGenerative Adversarial Network+3