paper-with-me

홈 › Papers

DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation

2023-09-28 · Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, Gang Zeng

Recent advances in 3D content creation mostly leverage optimization-based 3D generation via score distillation sampling (SDS). Though promising results have been exhibited, these methods often suffer from slow per-sample optimization, limiting their practical usage. In this paper, we propose DreamGaussian, a novel 3D content generation framework that achieves both efficiency and quality simultaneously. Our key insight is to design a generative 3D Gaussian Splatting model with companioned mesh extraction and texture refinement in UV space. In contrast to the occupancy pruning used in Neural Radiance Fields, we demonstrate that the progressive densification of 3D Gaussians converges significantly faster for 3D generative tasks. To further enhance the texture quality and facilitate downstream applications, we introduce an efficient algorithm to convert 3D Gaussians into textured meshes and apply a fine-tuning stage to refine the details. Extensive experiments demonstrate the superior efficiency and competitive generation quality of our proposed approach. Notably, DreamGaussian produces high-quality textured meshes in just 2 minutes from a single-view image, achieving approximately 10 times acceleration compared to existing methods.

📄 PDF Abstract BibTeX arXiv:2309.16653

Code (1)

dreamgaussian/dreamgaussian 공식 구현 pytorch

Tasks

3D Generation

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

DreamGaussian4D: Generative 4D Gaussian Splatting

2023-12-28 · Jiawei Ren, Liang Pan, Jiaxiang Tang, Chi Zhang 외

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce …

Video Generation

Exploring the Feasibility of Generating Realistic 3D Models of Endangered Species Using DreamGaussian: An Analysis of Elevation Angle's Impact on Model Generation

2023-12-15 · Selcuk Anil Karatopak, Deniz Sen

Many species face the threat of extinction. It's important to study these species and gather information about them as much as possible to preserve biodiversity. Due to the rarity of endangered species, there is a limite…

GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting

2024-03-08 · Francesco Palandra, Andrea Sanchietti, Daniele Baieri, Emanuele Rodolà

We present GSEdit, a pipeline for text-guided 3D object editing based on Gaussian Splatting models. Our method enables the editing of the style and appearance of 3D objects without altering their main details, all in a m…

3D Object EditingNeRFObject

GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation

2024-03-19 · Quankai Gao, Qiangeng Xu, Zhe Cao, Ben Mildenhall 외

Creating 4D fields of Gaussian Splatting from images or videos is a challenging task due to its under-constrained nature. While the optimization can draw photometric reference from the input videos or be regulated by gen…

Novel View SynthesisOptical Flow Estimation

Generative Object Insertion in Gaussian Splatting with a Multi-View Diffusion Model

2024-09-25 · Hongliang Zhong, Can Wang, Jingbo Zhang, Jing Liao

Generating and inserting new objects into 3D content is a compelling approach for achieving versatile scene recreation. Existing methods, which rely on SDS optimization or single-view inpainting, often struggle to produc…

3D ReconstructionObject