paper-with-me

홈 › Papers

NAS-NeRF: Generative Neural Architecture Search for Neural Radiance Fields

2023-09-25 · Saeejith Nair, Yuhao Chen, Mohammad Javad Shafiee, Alexander Wong

Neural radiance fields (NeRFs) enable high-quality novel view synthesis, but their high computational complexity limits deployability. While existing neural-based solutions strive for efficiency, they use one-size-fits-all architectures regardless of scene complexity. The same architecture may be unnecessarily large for simple scenes but insufficient for complex ones. Thus, there is a need to dynamically optimize the neural network component of NeRFs to achieve a balance between computational complexity and specific targets for synthesis quality. We introduce NAS-NeRF, a generative neural architecture search strategy that generates compact, scene-specialized NeRF architectures by balancing architecture complexity and target synthesis quality metrics. Our method incorporates constraints on target metrics and budgets to guide the search towards architectures tailored for each scene. Experiments on the Blender synthetic dataset show the proposed NAS-NeRF can generate architectures up to 5.74$\times$ smaller, with 4.19$\times$ fewer FLOPs, and 1.93$\times$ faster on a GPU than baseline NeRFs, without suffering a drop in SSIM. Furthermore, we illustrate that NAS-NeRF can also achieve architectures up to 23$\times$ smaller, with 22$\times$ fewer FLOPs, and 4.7$\times$ faster than baseline NeRFs with only a 5.3% average SSIM drop. Our source code is also made publicly available at https://saeejithnair.github.io/NAS-NeRF.

📄 PDF Abstract BibTeX arXiv:2309.14293

Code (0)

등록된 구현이 없습니다.

Tasks

GPUNeRFNeural Architecture SearchNovel View SynthesisSSIM

Methods 이 논문이 사용한 방법론

RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
RoIPool 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation

2024-03-28 · Yujin Chen, Yinyu Nie, Benjamin Ummenhofer, Reiner Birkl 외

We present Mesh2NeRF, an approach to derive ground-truth radiance fields from textured meshes for 3D generation tasks. Many 3D generative approaches represent 3D scenes as radiance fields for training. Their ground-truth…

3D GenerationNeRF

CG-NeRF: Conditional Generative Neural Radiance Fields

2021-12-07 · Kyungmin Jo, Gyumin Shim, Sanghun Jung, Soyoung Yang 외

While recent NeRF-based generative models achieve the generation of diverse 3D-aware images, these approaches have limitations when generating images that contain user-specified characteristics. In this paper, we propose…

3D-Aware Image SynthesisDiversityFace GenerationImage Generation+1

AE-NeRF: Auto-Encoding Neural Radiance Fields for 3D-Aware Object Manipulation

2022-04-28 · Mira Kim, Jaehoon Ko, Kyusun Cho, Junmyeong Choi 외

We propose a novel framework for 3D-aware object manipulation, called Auto-Encoding Neural Radiance Fields (AE-NeRF). Our model, which is formulated in an auto-encoder architecture, extracts disentangled 3D attributes su…

AttributeDisentanglementNeRF

NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshes

2023-03-16 · Marie-Julie Rakotosaona, Fabian Manhardt, Diego Martin Arroyo, Michael Niemeyer 외

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis usin…

NeRFNovel View SynthesisSurface Reconstruction

SegNeRF: 3D Part Segmentation with Neural Radiance Fields

2022-11-21 · Jesus Zarzar, Sara Rojas, Silvio Giancola, Bernard Ghanem

Recent advances in Neural Radiance Fields (NeRF) boast impressive performances for generative tasks such as novel view synthesis and 3D reconstruction. Methods based on neural radiance fields are able to represent the 3D…

3D Part Segmentation3D ReconstructionNeRFNovel View Synthesis+1