Single-View 3D Reconstruction via SO(2)-Equivariant Gaussian Sculpting Networks
This paper introduces SO(2)-Equivariant Gaussian Sculpting Networks (GSNs) as an approach for SO(2)-Equivariant 3D object reconstruction from single-view image observations. GSNs take a single observation as input to generate a Gaussian splat representation describing the observed object's geometry and texture. By using a shared feature extractor before decoding Gaussian colors, covariances, positions, and opacities, GSNs achieve extremely high throughput (>150FPS). Experiments demonstrate that GSNs can be trained efficiently using a multi-view rendering loss and are competitive, in quality, with expensive diffusion-based reconstruction algorithms. The GSN model is validated on multiple benchmark experiments. Moreover, we demonstrate the potential for GSNs to be used within a robotic manipulation pipeline for object-centric grasping.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object Reconstruction3D ReconstructionObjectObject ReconstructionSingle-View 3D ReconstructionSimilar Papers 제목 키워드 기반
Neural Kaleidoscopic Space Sculpting
We introduce a method that recovers full-surround 3D reconstructions from a single kaleidoscopic image using a neural surface representation. Full-surround 3D reconstruction is critical for many applications, such as…
3D ReconstructionstudentSplat: Your Student Model Learns Single-view 3D Gaussian Splatting
Recent advance in feed-forward 3D Gaussian splatting has enable remarkable multi-view 3D scene reconstruction or single-view 3D object reconstruction but single-view 3D scene reconstruction remain under-explored due to i…
3D Object ReconstructionDepth Estimation$SE(3)$ Equivariant Convolution and Transformer in Ray Space
3D reconstruction and novel view rendering can greatly benefit from geometric priors when the input views are not sufficient in terms of coverage and inter-view baselines. Deep learning of geometric priors from 2D images…
3D ReconstructionNeural Rendering$SE(3)$ Equivariant Convolution and Transformer in Ray Space
3D reconstruction and novel view rendering can greatly benefit from geometric priors when the input views are not sufficient in terms of coverage and inter-view baselines. Deep learning of geometric priors from 2D images…
3D ReconstructionNeural RenderingControllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting
While text-to-3D and image-to-3D generation tasks have received considerable attention, one important but under-explored field between them is controllable text-to-3D generation, which we mainly focus on in this work. To…
3D GenerationImage to 3DText to 3D