paper-with-me

Papers

nerf2nerf: Pairwise Registration of Neural Radiance Fields

2022-11-03 · Lily Goli, Daniel Rebain, Sara Sabour, Animesh Garg, Andrea Tagliasacchi

We introduce a technique for pairwise registration of neural fields that extends classical optimization-based local registration (i.e. ICP) to operate on Neural Radiance Fields (NeRF) -- neural 3D scene representations trained from collections of calibrated images. NeRF does not decompose illumination and color, so to make registration invariant to illumination, we introduce the concept of a ''surface field'' -- a field distilled from a pre-trained NeRF model that measures the likelihood of a point being on the surface of an object. We then cast nerf2nerf registration as a robust optimization that iteratively seeks a rigid transformation that aligns the surface fields of the two scenes. We evaluate the effectiveness of our technique by introducing a dataset of pre-trained NeRF scenes -- our synthetic scenes enable quantitative evaluations and comparisons to classical registration techniques, while our real scenes demonstrate the validity of our technique in real-world scenarios. Additional results available at: https://nerf2nerf.github.io

📄 PDF Abstract BibTeX arXiv:2211.01600

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

DReg-NeRF: Deep Registration for Neural Radiance Fields

2023-08-18 · ICCV 2023 1 · Yu Chen, Gim Hee Lee

Although Neural Radiance Fields (NeRF) is popular in the computer vision community recently, registering multiple NeRFs has yet to gain much attention. Unlike the existing work, NeRF2NeRF, which is based on traditional o…

NeRFNovel View SynthesisPoint Cloud RegistrationRTE

VF-NeRF: Viewshed Fields for Rigid NeRF Registration

2024-04-04 · Leo Segre, Shai Avidan

3D scene registration is a fundamental problem in computer vision that seeks the best 6-DoF alignment between two scenes. This problem was extensively investigated in the case of point clouds and meshes, but there has be…

NeRFPosition

BARF: Bundle-Adjusting Neural Radiance Fields

2021-04-13 · ICCV 2021 10 · Chen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, Simon Lucey

Neural Radiance Fields (NeRF) have recently gained a surge of interest within the computer vision community for its power to synthesize photorealistic novel views of real-world scenes. One limitation of NeRF, however, is…

NeRFVisual Localization

NeRFuser: Large-Scale Scene Representation by NeRF Fusion

2023-05-22 · Jiading Fang, Shengjie Lin, Igor Vasiljevic, Vitor Guizilini 외

A practical benefit of implicit visual representations like Neural Radiance Fields (NeRFs) is their memory efficiency: large scenes can be efficiently stored and shared as small neural nets instead of collections of imag…

NeRF

Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields

2022-11-21 · CVPR 2023 1 · Yue Chen, Xingyu Chen, Xuan Wang, Qi Zhang 외

Neural Radiance Fields (NeRF) have achieved photorealistic novel views synthesis; however, the requirement of accurate camera poses limits its application. Despite analysis-by-synthesis extensions for jointly learning ne…

NeRFparameter estimation