Local Implicit Grid Representations for 3D Scenes
Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, complexity, or diversity. In this paper, we introduce Local Implicit Grid Representations, a new 3D shape representation designed for scalability and generality. The motivating idea is that most 3D surfaces share geometric details at some scale -- i.e., at a scale smaller than an entire object and larger than a small patch. We train an autoencoder to learn an embedding of local crops of 3D shapes at that size. Then, we use the decoder as a component in a shape optimization that solves for a set of latent codes on a regular grid of overlapping crops such that an interpolation of the decoded local shapes matches a partial or noisy observation. We demonstrate the value of this proposed approach for 3D surface reconstruction from sparse point observations, showing significantly better results than alternative approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Shape RepresentationDecoderDiversitySurface ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Local Implicit Grid Representations for 3D Scenes
Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, co…
3D Shape RepresentationDecoderDiversitySurface ReconstructionOriented-grid Encoder for 3D Implicit Representations
Encoding 3D points is one of the primary steps in learning-based implicit scene representation. Using features that gather information from neighbors with multi-resolution grids has proven to be the best geometric encode…
Affine-Equivariant Kernel Space Encoding for NeRF Editing
Neural scene representations achieve high-fidelity rendering by encoding 3D scenes as continuous functions, but their latent spaces are typically implicit and globally entangled, making localized editing and physically g…
MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction
In recent years, neural implicit surface reconstruction methods have become popular for multi-view 3D reconstruction. In contrast to traditional multi-view stereo methods, these approaches tend to produce smoother and mo…
3D ReconstructionMulti-View 3D ReconstructionSurface ReconstructionCompact Neural Volumetric Video Representations with Dynamic Codebooks
This paper addresses the challenge of representing high-fidelity volumetric videos with low storage cost. Some recent feature grid-based methods have shown superior performance of fast learning implicit neural representa…