paper-with-me

홈 › Papers

NeRF-XL: Scaling NeRFs with Multiple GPUs

2024-04-24 · RuiLong Li, Sanja Fidler, Angjoo Kanazawa, Francis Williams

We present NeRF-XL, a principled method for distributing Neural Radiance Fields (NeRFs) across multiple GPUs, thus enabling the training and rendering of NeRFs with an arbitrarily large capacity. We begin by revisiting existing multi-GPU approaches, which decompose large scenes into multiple independently trained NeRFs, and identify several fundamental issues with these methods that hinder improvements in reconstruction quality as additional computational resources (GPUs) are used in training. NeRF-XL remedies these issues and enables the training and rendering of NeRFs with an arbitrary number of parameters by simply using more hardware. At the core of our method lies a novel distributed training and rendering formulation, which is mathematically equivalent to the classic single-GPU case and minimizes communication between GPUs. By unlocking NeRFs with arbitrarily large parameter counts, our approach is the first to reveal multi-GPU scaling laws for NeRFs, showing improvements in reconstruction quality with larger parameter counts and speed improvements with more GPUs. We demonstrate the effectiveness of NeRF-XL on a wide variety of datasets, including the largest open-source dataset to date, MatrixCity, containing 258K images covering a 25km^2 city area.

📄 PDF Abstract BibTeX arXiv:2404.16221

Code (0)

등록된 구현이 없습니다.

Tasks

GPUNeRF

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Block-NeRF: Scalable Large Scene Neural View Synthesis

2022-02-10 · CVPR 2022 1 · Matthew Tancik, Vincent Casser, Xinchen Yan, Sabeek Pradhan 외

We present Block-NeRF, a variant of Neural Radiance Fields that can represent large-scale environments. Specifically, we demonstrate that when scaling NeRF to render city-scale scenes spanning multiple blocks, it is vita…

NeRF

InterNeRF: Scaling Radiance Fields via Parameter Interpolation

2024-06-17 · Clinton Wang, Peter Hedman, Polina Golland, Jonathan T. Barron 외

Neural Radiance Fields (NeRFs) have unmatched fidelity on large, real-world scenes. A common approach for scaling NeRFs is to partition the scene into regions, each of which is assigned its own parameters. When implement…

Creating Visual Effects with Neural Radiance Fields

2023-12-11 · Cyrus Vachha

We present a pipeline for integrating NeRFs into traditional compositing VFX pipelines using Nerfstudio, an open-source framework for training and rendering NeRFs. Our approach involves using Blender, a widely used open-…

NeRF

Tile and Slide : A New Framework for Scaling NeRF from Local to Global 3D Earth Observation

2025-07-02 · Camille Billouard, Dawa Derksen, Alexandre Constantin, Bruno Vallet arxiv

Neural Radiance Fields (NeRF) have recently emerged as a paradigm for 3D reconstruction from multiview satellite imagery. However, state-of-the-art NeRF methods are typically constrained to small scenes due to the memory…

3D Reconstruction

Learning Neural Duplex Radiance Fields for Real-Time View Synthesis

2023-04-20 · CVPR 2023 1 · Ziyu Wan, Christian Richardt, Aljaž Božič, Chao Li 외

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pi…

Novel View SynthesisSurface Reconstruction