paper-with-me

Papers

Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models

2023-12-13 · Liangchen Song, Liangliang Cao, Jiatao Gu, Yifan Jiang, Junsong Yuan, Hao Tang

The advancement of text-driven 3D content editing has been blessed by the progress from 2D generative diffusion models. However, a major obstacle hindering the widespread adoption of 3D content editing is its time-intensive processing. This challenge arises from the iterative and refining steps required to achieve consistent 3D outputs from 2D image-based generative models. Recent state-of-the-art methods typically require optimization time ranging from tens of minutes to several hours to edit a 3D scene using a single GPU. In this work, we propose that by incorporating correspondence regularization into diffusion models, the process of 3D editing can be significantly accelerated. This approach is inspired by the notion that the estimated samples during diffusion should be multiview-consistent during the diffusion generation process. By leveraging this multiview consistency, we can edit 3D content at a much faster speed. In most scenarios, our proposed technique brings a 10$\times$ speed-up compared to the baseline method and completes the editing of a 3D scene in 2 minutes with comparable quality.

📄 PDF Abstract BibTeX arXiv:2312.08563

Code (0)

등록된 구현이 없습니다.

Tasks

GPU

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields

2023-08-23 · ICCV 2023 1 · Hyeonseop Song, Seokhun Choi, Hoseok Do, Chul Lee 외

Text-driven localized editing of 3D objects is particularly difficult as locally mixing the original 3D object with the intended new object and style effects without distorting the object's form is not a straightforward …

NeRFObject

DATENeRF: Depth-Aware Text-based Editing of NeRFs

2024-04-06 · Sara Rojas, Julien Philip, Kai Zhang, Sai Bi 외

Recent advancements in diffusion models have shown remarkable proficiency in editing 2D images based on text prompts. However, extending these techniques to edit scenes in Neural Radiance Fields (NeRF) is complex, as edi…

NeRF

FaceDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion Models

2023-06-01 · NeurIPS 2023 11 · Hao Zhang, Yanbo Xu, Tianyuan Dai, Yu-Wing Tai 외

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we pro…

3D Face ReconstructionFace ReconstructionNeRFVideo Editing+1

GenN2N: Generative NeRF2NeRF Translation

2024-04-03 · CVPR 2024 1 · Xiangyue Liu, Han Xue, Kunming Luo, Ping Tan 외

We present GenN2N, a unified NeRF-to-NeRF translation framework for various NeRF translation tasks such as text-driven NeRF editing, colorization, super-resolution, inpainting, etc. Unlike previous methods designed for i…

ColorizationContrastive LearningNeRFSuper-Resolution+1

Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training

2023-12-04 · CVPR 2024 1 · Runze He, Shaofei Huang, Xuecheng Nie, Tianrui Hui 외

In this paper, we target the adaptive source driven 3D scene editing task by proposing a CustomNeRF model that unifies a text description or a reference image as the editing prompt. However, obtaining desired editing res…

3D scene EditingNeRF