paper-with-me

홈 › Papers

Creating Visual Effects with Neural Radiance Fields

2023-12-11 · Cyrus Vachha

We present a pipeline for integrating NeRFs into traditional compositing VFX pipelines using Nerfstudio, an open-source framework for training and rendering NeRFs. Our approach involves using Blender, a widely used open-source 3D creation software, to align camera paths and composite NeRF renders with meshes and other NeRFs, allowing for seamless integration of NeRFs into traditional VFX pipelines. Our NeRF Blender add-on allows for more controlled camera trajectories of photorealistic scenes, compositing meshes and other environmental effects with NeRFs, and compositing multiple NeRFs in a single scene.This approach of generating NeRF aligned camera paths can be adapted to other 3D tool sets and workflows, enabling a more seamless integration of NeRFs into visual effects and film production. Documentation can be found here: https://docs.nerf.studio/extensions/blender_addon.html

📄 PDF Abstract BibTeX arXiv:2401.08633

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
RoIPool 설명 없음

Similar Papers 제목 키워드 기반

Bilateral Guided Radiance Field Processing

2024-06-01 · Yuehao Wang, Chaoyi Wang, Bingchen Gong, Tianfan Xue

Neural Radiance Fields (NeRF) achieves unprecedented performance in synthesizing novel view synthesis, utilizing multi-view consistency. When capturing multiple inputs, image signal processing (ISP) in modern cameras wil…

NeRFNovel View SynthesisTone Mapping

ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field

2022-11-23 · ICCV 2023 1 · Yuan Li, Zhi-Hao Lin, David Forsyth, Jia-Bin Huang 외

Physical simulations produce excellent predictions of weather effects. Neural radiance fields produce SOTA scene models. We describe a novel NeRF-editing procedure that can fuse physical simulations with NeRF models of s…

NeRFNeural RenderingPhysical Simulations

RGB-D Mapping and Tracking in a Plenoxel Radiance Field

2023-07-07 · Andreas L. Teigen, Yeonsoo Park, Annette Stahl, Rudolf Mester

The widespread adoption of Neural Radiance Fields (NeRFs) have ensured significant advances in the domain of novel view synthesis in recent years. These models capture a volumetric radiance field of a scene, creating hig…

3D ReconstructionNovel View Synthesis

TUVF: Learning Generalizable Texture UV Radiance Fields

2023-05-04 · An-Chieh Cheng, Xueting Li, Sifei Liu, Xiaolong Wang

Textures are a vital aspect of creating visually appealing and realistic 3D models. In this paper, we study the problem of generating high-fidelity texture given shapes of 3D assets, which has been relatively less explor…

3D Shape ModelingTexture Synthesis

Creating Seamless 3D Maps Using Radiance Fields

2024-03-17 · Sai Tarun Sathyan, Thomas B. Kinsman

It is desirable to create 3D object models and 3D maps from 2D input images for applications such as navigation, virtual tourism, and urban planning. The traditional methods of creating 3D maps, (such as photogrammetry),…

NeRFObject