paper-with-me

홈 › Papers

Towards a Robust Framework for NeRF Evaluation

2023-05-29 · Adrian Azzarelli, Nantheera Anantrasirichai, David R Bull

Neural Radiance Field (NeRF) research has attracted significant attention recently, with 3D modelling, virtual/augmented reality, and visual effects driving its application. While current NeRF implementations can produce high quality visual results, there is a conspicuous lack of reliable methods for evaluating them. Conventional image quality assessment methods and analytical metrics (e.g. PSNR, SSIM, LPIPS etc.) only provide approximate indicators of performance since they generalise the ability of the entire NeRF pipeline. Hence, in this paper, we propose a new test framework which isolates the neural rendering network from the NeRF pipeline and then performs a parametric evaluation by training and evaluating the NeRF on an explicit radiance field representation. We also introduce a configurable approach for generating representations specifically for evaluation purposes. This employs ray-casting to transform mesh models into explicit NeRF samples, as well as to "shade" these representations. Combining these two approaches, we demonstrate how different "tasks" (scenes with different visual effects or learning strategies) and types of networks (NeRFs and depth-wise implicit neural representations (INRs)) can be evaluated within this framework. Additionally, we propose a novel metric to measure task complexity of the framework which accounts for the visual parameters and the distribution of the spatial data. Our approach offers the potential to create a comparative objective evaluation framework for NeRF methods.

📄 PDF Abstract BibTeX arXiv:2305.18079

Code (1)

azzarelli/wape 공식 구현 pytorch

Tasks

3D Depth EstimationImage Quality AssessmentNeRFNeural RenderingSSIM

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

OPONeRF: One-Point-One NeRF for Robust Neural Rendering

2024-09-30 · Yu Zheng, Yueqi Duan, Kangfu Zheng, Hongru Yan 외

In this paper, we propose a One-Point-One NeRF (OPONeRF) framework for robust scene rendering. Existing NeRFs are designed based on a key assumption that the target scene remains unchanged between the training and test t…

NeRFNeural Rendering

$S^2$NeRF: Privacy-preserving Training Framework for NeRF

2024-09-03 · Bokang Zhang, Yanglin Zhang, Zhikun Zhang, Jinglan Yang 외

Neural Radiance Fields (NeRF) have revolutionized 3D computer vision and graphics, facilitating novel view synthesis and influencing sectors like extended reality and e-commerce. However, NeRF's dependence on extensive d…

NeRFNovel View SynthesisPrivacy Preserving

StegaNeRF: Embedding Invisible Information within Neural Radiance Fields

2022-12-03 · ICCV 2023 1 · Chenxin Li, Brandon Y. Feng, Zhiwen Fan, Panwang Pan 외

Recent advances in neural rendering imply a future of widespread visual data distributions through sharing NeRF model weights. However, while common visual data (images and videos) have standard approaches to embed owner…

NeRFNeural Rendering

Matching Query Image Against Selected NeRF Feature for Efficient and Scalable Localization

2024-06-17 · Huaiji Zhou, Bing Wang, Changhao Chen

Neural implicit representations such as NeRF have revolutionized 3D scene representation with photo-realistic quality. However, existing methods for visual localization within NeRF representations suffer from inefficienc…

feature selectionNeRFPose EstimationScene Segmentation+1

NERFIFY: A Multi-Agent Framework for Turning NeRF Papers into Code

2026-02-28 · Seemandhar Jain, Keshav Gupta, Kunal Gupta, Manmohan Chandraker arxiv

The proliferation of neural radiance field (NeRF) research requires significant efforts to reimplement papers before building upon them. We introduce NERFIFY, a multi-agent framework that reliably converts NeRF research …

Code Translation