paper-with-me

홈 › Papers

Autoregressive 3D Shape Generation via Canonical Mapping

2022-04-05 · An-Chieh Cheng, Xueting Li, Sifei Liu, Min Sun, Ming-Hsuan Yang

With the capacity of modeling long-range dependencies in sequential data, transformers have shown remarkable performances in a variety of generative tasks such as image, audio, and text generation. Yet, taming them in generating less structured and voluminous data formats such as high-resolution point clouds have seldom been explored due to ambiguous sequentialization processes and infeasible computation burden. In this paper, we aim to further exploit the power of transformers and employ them for the task of 3D point cloud generation. The key idea is to decompose point clouds of one category into semantically aligned sequences of shape compositions, via a learned canonical space. These shape compositions can then be quantized and used to learn a context-rich composition codebook for point cloud generation. Experimental results on point cloud reconstruction and unconditional generation show that our model performs favorably against state-of-the-art approaches. Furthermore, our model can be easily extended to multi-modal shape completion as an application for conditional shape generation.

📄 PDF Abstract BibTeX arXiv:2204.01955

Code (1)

AnjieCheng/CanonicalVAE 공식 구현 pytorch

Tasks

3D Shape GenerationPoint Cloud GenerationPoint cloud reconstruction

Similar Papers 제목 키워드 기반

GlobalMapper: Arbitrary-Shaped Urban Layout Generation

2023-07-19 · ICCV 2023 1 · Liu He, Daniel Aliaga

Modeling and designing urban building layouts is of significant interest in computer vision, computer graphics, and urban applications. A building layout consists of a set of buildings in city blocks defined by a network…

Graph AttentionLayout Generation

Probabilistic Shape Completion by Estimating Canonical Factors with Hierarchical VAE

2022-12-06 · Wen Jiang, Kostas Daniilidis

We propose a novel method for 3D shape completion from a partial observation of a point cloud. Existing methods either operate on a global latent code, which limits the expressiveness of their model, or autoregressively …

Articulation-aware Canonical Surface Mapping

2020-04-01 · CVPR 2020 6 · Nilesh Kulkarni, Abhinav Gupta, David F. Fouhey, Shubham Tulsiani

We tackle the tasks of: 1) predicting a Canonical Surface Mapping (CSM) that indicates the mapping from 2D pixels to corresponding points on a canonical template shape, and 2) inferring the articulation and pose of the t…

OctGPT: Octree-based Multiscale Autoregressive Models for 3D Shape Generation

2025-04-14 · Si-Tong Wei, Rui-Huan Wang, Chuan-Zhi Zhou, Baoquan Chen 외

Autoregressive models have achieved remarkable success across various domains, yet their performance in 3D shape generation lags significantly behind that of diffusion models. In this paper, we introduce OctGPT, a novel …

3D Shape Generation

Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured Sequences

2021-11-24 · Moritz Ibing, Gregor Kobsik, Leif Kobbelt

Autoregressive models have proven to be very powerful in NLP text generation tasks and lately have gained popularity for image generation as well. However, they have seen limited use for the synthesis of 3D shapes so far…

3D Shape GenerationImage GenerationText Generation