paper-with-me

Papers

Adaptive Positional Encoding for Bundle-Adjusting Neural Radiance Fields

2023-01-01 · ICCV 2023 1 · Zelin Gao, Weichen Dai, Yu Zhang

Neural Radiance Fields have shown great potential to synthesize novel views with only a few discrete image observations of the world. However, the requirement of accurate camera parameters to learn scene representations limits its further application. In this paper, we present adaptive positional encoding (APE) for bundle-adjusting neural radiance fields to reconstruct the neural radiance fields from unknown camera poses (or even intrinsics). Inspired by Fourier series regression, we investigate its relationship with the positional encoding method and therefore propose APE where all frequency bands are trainable. Furthermore, we introduce period-activated multilayer perceptrons (PMLPs) to construct the implicit network for the high-order scene representations and fine-grain gradients during backpropagation. Experimental results on public datasets demonstrate that the proposed method with APE and PMLPs can outperform the state-of-the-art methods in accurate camera poses and high-fidelity view synthesis.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

BARF: Bundle-Adjusting Neural Radiance Fields

2021-04-13 · ICCV 2021 10 · Chen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, Simon Lucey

Neural Radiance Fields (NeRF) have recently gained a surge of interest within the computer vision community for its power to synthesize photorealistic novel views of real-world scenes. One limitation of NeRF, however, is…

NeRFVisual Localization

BAA-NGP: Bundle-Adjusting Accelerated Neural Graphics Primitives

2023-06-07 · Sainan Liu, Shan Lin, Jingpei Lu, Alexey Supikov 외

Implicit neural representations have become pivotal in robotic perception, enabling robots to comprehend 3D environments from 2D images. Given a set of camera poses and associated images, the models can be trained to syn…

3D Scene ReconstructionNavigateNovel View SynthesisPose Estimation+1

Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields

2022-11-21 · CVPR 2023 1 · Yue Chen, Xingyu Chen, Xuan Wang, Qi Zhang 외

Neural Radiance Fields (NeRF) have achieved photorealistic novel views synthesis; however, the requirement of accurate camera poses limits its application. Despite analysis-by-synthesis extensions for jointly learning ne…

NeRFparameter estimation

CBARF: Cascaded Bundle-Adjusting Neural Radiance Fields from Imperfect Camera Poses

2023-10-15 · Hongyu Fu, Xin Yu, Lincheng Li, Li Zhang

Existing volumetric neural rendering techniques, such as Neural Radiance Fields (NeRF), face limitations in synthesizing high-quality novel views when the camera poses of input images are imperfect. To address this issue…

3D ReconstructionNeRFNeural RenderingNovel View Synthesis

DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fields

2023-03-25 · CVPR 2023 1 · Yu Chen, Gim Hee Lee

Recent works such as BARF and GARF can bundle adjust camera poses with neural radiance fields (NeRF) which is based on coordinate-MLPs. Despite the impressive results, these methods cannot be applied to Generalizable NeR…

NeRF