paper-with-me

홈 › Papers

Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representations

2022-05-05 · Peng-Shuai Wang, Yang Liu, Xin Tong

We present an adaptive deep representation of volumetric fields of 3D shapes and an efficient approach to learn this deep representation for high-quality 3D shape reconstruction and auto-encoding. Our method encodes the volumetric field of a 3D shape with an adaptive feature volume organized by an octree and applies a compact multilayer perceptron network for mapping the features to the field value at each 3D position. An encoder-decoder network is designed to learn the adaptive feature volume based on the graph convolutions over the dual graph of octree nodes. The core of our network is a new graph convolution operator defined over a regular grid of features fused from irregular neighboring octree nodes at different levels, which not only reduces the computational and memory cost of the convolutions over irregular neighboring octree nodes, but also improves the performance of feature learning. Our method effectively encodes shape details, enables fast 3D shape reconstruction, and exhibits good generality for modeling 3D shapes out of training categories. We evaluate our method on a set of reconstruction tasks of 3D shapes and scenes and validate its superiority over other existing approaches. Our code, data, and trained models are available at https://wang-ps.github.io/dualocnn.

📄 PDF Abstract BibTeX arXiv:2205.02825

Code (1)

microsoft/DualOctreeGNN 공식 구현 pytorch

Tasks

3D Shape ReconstructionDecoder

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Adaptive O-CNN: A Patch-based Deep Representation of 3D Shapes

2018-09-21 · Peng-Shuai Wang, Chun-Yu Sun, Yang Liu, Xin Tong

We present an Adaptive Octree-based Convolutional Neural Network (Adaptive O-CNN) for efficient 3D shape encoding and decoding. Different from volumetric-based or octree-based CNN methods that represent a 3D shape with v…

Decoder

Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs

2017-03-28 · ICCV 2017 10 · Maxim Tatarchenko, Alexey Dosovitskiy, Thomas Brox

We present a deep convolutional decoder architecture that can generate volumetric 3D outputs in a compute- and memory-efficient manner by using an octree representation. The network learns to predict both the structure o…

3D ReconstructionDecoderVocal Bursts Intensity Prediction

Efficient Autoregressive Shape Generation via Octree-Based Adaptive Tokenization

2025-04-03 · Kangle Deng, Hsueh-Ti Derek Liu, Yiheng Zhu, Xiaoxia Sun 외

Many 3D generative models rely on variational autoencoders (VAEs) to learn compact shape representations. However, existing methods encode all shapes into a fixed-size token, disregarding the inherent variations in scale…

Open-Vocabulary Octree-Graph for 3D Scene Understanding

2024-11-25 · Zhigang Wang, Yifei Su, Chenhui Li, Dong Wang 외

Open-vocabulary 3D scene understanding is indispensable for embodied agents. Recent works leverage pretrained vision-language models (VLMs) for object segmentation and project them to point clouds to build 3D maps. Despi…

ObjectScene UnderstandingSemantic Segmentation

O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis

2017-12-05 · Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun 외

We present O-CNN, an Octree-based Convolutional Neural Network (CNN) for 3D shape analysis. Built upon the octree representation of 3D shapes, our method takes the average normal vectors of a 3D model sampled in the fine…

3D Object ClassificationGPURetrievalSemantic Segmentation