BID-NeRF: RGB-D image pose estimation with inverted Neural Radiance Fields
We aim to improve the Inverted Neural Radiance Fields (iNeRF) algorithm which defines the image pose estimation problem as a NeRF based iterative linear optimization. NeRFs are novel neural space representation models that can synthesize photorealistic novel views of real-world scenes or objects. Our contributions are as follows: we extend the localization optimization objective with a depth-based loss function, we introduce a multi-image based loss function where a sequence of images with known relative poses are used without increasing the computational complexity, we omit hierarchical sampling during volumetric rendering, meaning only the coarse model is used for pose estimation, and we how that by extending the sampling interval convergence can be achieved even or higher initial pose estimate errors. With the proposed modifications the convergence speed is significantly improved, and the basin of convergence is substantially extended.
Code (0)
등록된 구현이 없습니다.
Tasks
NeRFPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SiNeRF: Sinusoidal Neural Radiance Fields for Joint Pose Estimation and Scene Reconstruction
NeRFmm is the Neural Radiance Fields (NeRF) that deal with Joint Optimization tasks, i.e., reconstructing real-world scenes and registering camera parameters simultaneously. Despite NeRFmm producing precise scene synthes…
Image GenerationNeRFPose EstimationUSB-NeRF: Unrolling Shutter Bundle Adjusted Neural Radiance Fields
Neural Radiance Fields (NeRF) has received much attention recently due to its impressive capability to represent 3D scene and synthesize novel view images. Existing works usually assume that the input images are captured…
Camera Pose EstimationImage GenerationMotion EstimationNeRF+2INeRF: Inverting Neural Radiance Fields for Pose Estimation
We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF). NeRFs have been shown to be remarkably effective for the task of view synthesis - synthesizing photoreal…
NeRFObjectPose EstimationPose-Free Neural Radiance Fields via Implicit Pose Regularization
Pose-free neural radiance fields (NeRF) aim to train NeRF with unposed multi-view images and it has achieved very impressive success in recent years. Most existing works share the pipeline of training a coarse pose estim…
NeRFNovel View SynthesisPose EstimationRobustifying the Multi-Scale Representation of Neural Radiance Fields
Neural Radiance Fields (NeRF) recently emerged as a new paradigm for object representation from multi-view (MV) images. Yet, it cannot handle multi-scale (MS) images and camera pose estimation errors, which generally is …
Camera Pose EstimationGraph Neural NetworkNeRFPose Estimation