paper-with-me

Papers

3D Neural Field Generation using Triplane Diffusion

2022-11-30 · CVPR 2023 1 · J. Ryan Shue, Eric Ryan Chan, Ryan Po, Zachary Ankner, Jiajun Wu, Gordon Wetzstein

Diffusion models have emerged as the state-of-the-art for image generation, among other tasks. Here, we present an efficient diffusion-based model for 3D-aware generation of neural fields. Our approach pre-processes training data, such as ShapeNet meshes, by converting them to continuous occupancy fields and factoring them into a set of axis-aligned triplane feature representations. Thus, our 3D training scenes are all represented by 2D feature planes, and we can directly train existing 2D diffusion models on these representations to generate 3D neural fields with high quality and diversity, outperforming alternative approaches to 3D-aware generation. Our approach requires essential modifications to existing triplane factorization pipelines to make the resulting features easy to learn for the diffusion model. We demonstrate state-of-the-art results on 3D generation on several object classes from ShapeNet.

📄 PDF Abstract BibTeX arXiv:2211.16677

Code (0)

등록된 구현이 없습니다.

Tasks

3D GenerationDiversityImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Blaze3DM: Marry Triplane Representation with Diffusion for 3D Medical Inverse Problem Solving

2024-05-24 · Jia He, Bonan Li, Ge Yang, Ziwen Liu

Solving 3D medical inverse problems such as image restoration and reconstruction is crucial in modern medical field. However, the curse of dimensionality in 3D medical data leads mainstream volume-wise methods to suffer …

compressed sensingComputational EfficiencyDecoderImage Restoration+1

SemCity: Semantic Scene Generation with Triplane Diffusion

2024-03-12 · CVPR 2024 1 · Jumin Lee, Sebin Lee, Changho Jo, Woobin Im 외

We present "SemCity," a 3D diffusion model for semantic scene generation in real-world outdoor environments. Most 3D diffusion models focus on generating a single object, synthetic indoor scenes, or synthetic outdoor sce…

Scene Generation

Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data

2025-03-27 · CVPR 2025 1 · Zhiyuan Ma, Xinyue Liang, Rongyuan Wu, Xiangyu Zhu 외

It is highly desirable to obtain a model that can generate high-quality 3D meshes from text prompts in just seconds. While recent attempts have adapted pre-trained text-to-image diffusion models, such as Stable Diffusion…

Text to 3D

3DGen: Triplane Latent Diffusion for Textured Mesh Generation

2023-03-09 · Anchit Gupta, Wenhan Xiong, Yixin Nie, Ian Jones 외

Latent diffusion models for image generation have crossed a quality threshold which enabled them to achieve mass adoption. Recently, a series of works have made advancements towards replicating this success in the 3D dom…

DiversityGPUImage GenerationTexture Synthesis

Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape

2023-05-24 · Rundi Wu, Ruoshi Liu, Carl Vondrick, Changxi Zheng

Synthesizing novel 3D models that resemble the input example has long been pursued by graphics artists and machine learning researchers. In this paper, we present Sin3DM, a diffusion model that learns the internal patch …

Denoising