paper-with-me

Papers

Shap-E: Generating Conditional 3D Implicit Functions

2023-05-03 · Heewoo Jun, Alex Nichol

We present Shap-E, a conditional generative model for 3D assets. Unlike recent work on 3D generative models which produce a single output representation, Shap-E directly generates the parameters of implicit functions that can be rendered as both textured meshes and neural radiance fields. We train Shap-E in two stages: first, we train an encoder that deterministically maps 3D assets into the parameters of an implicit function; second, we train a conditional diffusion model on outputs of the encoder. When trained on a large dataset of paired 3D and text data, our resulting models are capable of generating complex and diverse 3D assets in a matter of seconds. When compared to Point-E, an explicit generative model over point clouds, Shap-E converges faster and reaches comparable or better sample quality despite modeling a higher-dimensional, multi-representation output space. We release model weights, inference code, and samples at https://github.com/openai/shap-e.

📄 PDF Abstract BibTeX arXiv:2305.02463

Code (1)

openai/shap-e 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functions

2022-11-24 · ICCV 2023 1 · Gene Chou, Yuval Bahat, Felix Heide

Probabilistic diffusion models have achieved state-of-the-art results for image synthesis, inpainting, and text-to-image tasks. However, they are still in the early stages of generating complex 3D shapes. This work propo…

Image Generation

UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion

2024-04-10 · CVPR 2024 1 · Junsheng Zhou, Weiqi Zhang, Baorui Ma, Kanle Shi 외

Diffusion models have shown remarkable results for image generation, editing and inpainting. Recent works explore diffusion models for 3D shape generation with neural implicit functions, i.e., signed distance function an…

3D Shape GenerationImage Generation

Deep Implicit Templates for 3D Shape Representation

2020-11-30 · CVPR 2021 1 · Zerong Zheng, Tao Yu, Qionghai Dai, Yebin Liu

Deep implicit functions (DIFs), as a kind of 3D shape representation, are becoming more and more popular in the 3D vision community due to their compactness and strong representation power. However, unlike polygon mesh-b…

3D Shape Representation

Learning Implicit Functions for Topology-Varying Dense 3D Shape Correspondence

2020-10-23 · NeurIPS 2020 12 · Feng Liu, Xiaoming Liu

The goal of this paper is to learn dense 3D shape correspondence for topology-varying objects in an unsupervised manner. Conventional implicit functions estimate the occupancy of a 3D point given a shape latent code. Ins…

Semantic correspondence

Learning Implicit Functions for Dense 3D Shape Correspondence of Generic Objects

2022-12-29 · Feng Liu, Xiaoming Liu

The objective of this paper is to learn dense 3D shape correspondence for topology-varying generic objects in an unsupervised manner. Conventional implicit functions estimate the occupancy of a 3D point given a shape lat…

Semantic correspondence