paper-with-me

Papers

ROAD: Learning an Implicit Recursive Octree Auto-Decoder to Efficiently Encode 3D Shapes

2022-12-12 · Sergey Zakharov, Rares Ambrus, Katherine Liu, Adrien Gaidon

Compact and accurate representations of 3D shapes are central to many perception and robotics tasks. State-of-the-art learning-based methods can reconstruct single objects but scale poorly to large datasets. We present a novel recursive implicit representation to efficiently and accurately encode large datasets of complex 3D shapes by recursively traversing an implicit octree in latent space. Our implicit Recursive Octree Auto-Decoder (ROAD) learns a hierarchically structured latent space enabling state-of-the-art reconstruction results at a compression ratio above 99%. We also propose an efficient curriculum learning scheme that naturally exploits the coarse-to-fine properties of the underlying octree spatial representation. We explore the scaling law relating latent space dimension, dataset size, and reconstruction accuracy, showing that increasing the latent space dimension is enough to scale to large shape datasets. Finally, we show that our learned latent space encodes a coarse-to-fine hierarchical structure yielding reusable latents across different levels of details, and we provide qualitative evidence of generalization to novel shapes outside the training set.

📄 PDF Abstract BibTeX arXiv:2212.06193

Code (0)

등록된 구현이 없습니다.

Tasks

Decoder

Similar Papers 제목 키워드 기반

OctField: Hierarchical Implicit Functions for 3D Modeling

2021-11-01 · NeurIPS 2021 12 · Jia-Heng Tang, Weikai Chen, Jie Yang, Bo wang 외

Recent advances in localized implicit functions have enabled neural implicit representation to be scalable to large scenes. However, the regular subdivision of 3D space employed by these approaches fails to take into acc…

RocNet: Recursive Octree Network for Efficient 3D Deep Representation

2020-08-10 · Juncheng Liu, Steven Mills, Brendan McCane

We introduce a deep recursive octree network for the compression of 3D voxel data. Our network compresses a voxel grid of any size down to a very small latent space in an autoencoder-like network. We show results for com…

3D Reconstruction3D Shape Classification3D Shape Reconstruction

Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs

2017-03-28 · ICCV 2017 10 · Maxim Tatarchenko, Alexey Dosovitskiy, Thomas Brox

We present a deep convolutional decoder architecture that can generate volumetric 3D outputs in a compute- and memory-efficient manner by using an octree representation. The network learns to predict both the structure o…

3D ReconstructionDecoderVocal Bursts Intensity Prediction

RIM-Net: Recursive Implicit Fields for Unsupervised Learning of Hierarchical Shape Structures

2022-01-30 · CVPR 2022 1 · Chengjie Niu, Manyi Li, Kai Xu, Hao Zhang

We introduce RIM-Net, a neural network which learns recursive implicit fields for unsupervised inference of hierarchical shape structures. Our network recursively decomposes an input 3D shape into two parts, resulting in…

Decoder

OctFusion: Octree-based Diffusion Models for 3D Shape Generation

2024-08-27 · Bojun Xiong, Si-Tong Wei, Xin-Yang Zheng, Yan-Pei Cao 외

Diffusion models have emerged as a popular method for 3D generation. However, it is still challenging for diffusion models to efficiently generate diverse and high-quality 3D shapes. In this paper, we introduce OctFusion…

3D Generation3D Shape GenerationGPU