Hybrid bundle-adjusting 3D Gaussians for view consistent rendering with pose optimization
Novel view synthesis has made significant progress in the field of 3D computer vision. However, the rendering of view-consistent novel views from imperfect camera poses remains challenging. In this paper, we introduce a hybrid bundle-adjusting 3D Gaussians model that enables view-consistent rendering with pose optimization. This model jointly extract image-based and neural 3D representations to simultaneously generate view-consistent images and camera poses within forward-facing scenes. The effective of our model is demonstrated through extensive experiments conducted on both real and synthetic datasets. These experiments clearly illustrate that our model can effectively optimize neural scene representations while simultaneously resolving significant camera pose misalignments. The source code is available at https://github.com/Bistu3DV/hybridBA.
Code (1)
Tasks
Novel View SynthesisSimilar Papers 제목 키워드 기반
BAA-NGP: Bundle-Adjusting Accelerated Neural Graphics Primitives
Implicit neural representations have become pivotal in robotic perception, enabling robots to comprehend 3D environments from 2D images. Given a set of camera poses and associated images, the models can be trained to syn…
3D Scene ReconstructionNavigateNovel View SynthesisPose Estimation+1SmileSplat: Generalizable Gaussian Splats for Unconstrained Sparse Images
Sparse Multi-view Images can be Learned to predict explicit radiance fields via Generalizable Gaussian Splatting approaches, which can achieve wider application prospects in real-life when ground-truth camera parameters …
DecoderNovel View SynthesisTrackNeRF: Bundle Adjusting NeRF from Sparse and Noisy Views via Feature Tracks
Neural radiance fields (NeRFs) generally require many images with accurate poses for accurate novel view synthesis, which does not reflect realistic setups where views can be sparse and poses can be noisy. Previous solut…
NeRFNovel View SynthesisCBARF: Cascaded Bundle-Adjusting Neural Radiance Fields from Imperfect Camera Poses
Existing volumetric neural rendering techniques, such as Neural Radiance Fields (NeRF), face limitations in synthesizing high-quality novel views when the camera poses of input images are imperfect. To address this issue…
3D ReconstructionNeRFNeural RenderingNovel View SynthesisAdaptive Positional Encoding for Bundle-Adjusting Neural Radiance Fields
Neural Radiance Fields have shown great potential to synthesize novel views with only a few discrete image observations of the world. However, the requirement of accurate camera parameters to learn scene representati…