paper-with-me

홈 › Papers

Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering

2024-03-21 · Antoine Guédon, Vincent Lepetit

We propose Gaussian Frosting, a novel mesh-based representation for high-quality rendering and editing of complex 3D effects in real-time. Our approach builds on the recent 3D Gaussian Splatting framework, which optimizes a set of 3D Gaussians to approximate a radiance field from images. We propose first extracting a base mesh from Gaussians during optimization, then building and refining an adaptive layer of Gaussians with a variable thickness around the mesh to better capture the fine details and volumetric effects near the surface, such as hair or grass. We call this layer Gaussian Frosting, as it resembles a coating of frosting on a cake. The fuzzier the material, the thicker the frosting. We also introduce a parameterization of the Gaussians to enforce them to stay inside the frosting layer and automatically adjust their parameters when deforming, rescaling, editing or animating the mesh. Our representation allows for efficient rendering using Gaussian splatting, as well as editing and animation by modifying the base mesh. We demonstrate the effectiveness of our method on various synthetic and real scenes, and show that it outperforms existing surface-based approaches. We will release our code and a web-based viewer as additional contributions. Our project page is the following: https://anttwo.github.io/frosting/

📄 PDF Abstract BibTeX arXiv:2403.14554

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
BASE 설명 없음

Similar Papers 제목 키워드 기반

Generating Editable Head Avatars with 3D Gaussian GANs

2024-12-26 · Guohao Li, Hongyu Yang, Yifang Men, Di Huang 외

Generating animatable and editable 3D head avatars is essential for various applications in computer vision and graphics. Traditional 3D-aware generative adversarial networks (GANs), often using implicit fields like Neur…

3DGSNeRF

pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction

2023-12-19 · CVPR 2024 1 · David Charatan, Sizhe Li, Andrea Tagliasacchi, Vincent Sitzmann

We introduce pixelSplat, a feed-forward model that learns to reconstruct 3D radiance fields parameterized by 3D Gaussian primitives from pairs of images. Our model features real-time and memory-efficient rendering for sc…

3D ReconstructionGeneralizable Novel View SynthesisNovel View Synthesis

EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points

2022-12-07 · CVPR 2023 1 · Chengwei Zheng, Wenbin Lin, Feng Xu

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neura…

NeRFNovel View Synthesis

Point-Based Radiance Fields for Controllable Human Motion Synthesis

2023-10-05 · HaiTao Yu, Deheng Zhang, Peiyuan Xie, Tianyi Zhang

This paper proposes a novel controllable human motion synthesis method for fine-level deformation based on static point-based radiance fields. Although previous editable neural radiance field methods can generate impress…

Motion SynthesisNovel View Synthesis

OneTo3D: One Image to Re-editable Dynamic 3D Model and Video Generation

2024-05-10 · Jinwei Lin

One image to editable dynamic 3D model and video generation is novel direction and change in the research area of single image to 3D representation or 3D reconstruction of image. Gaussian Splatting has demonstrated its a…

3D ReconstructionImage to 3DVideo Generation