paper-with-me

홈 › Papers

AG-NeRF: Attention-guided Neural Radiance Fields for Multi-height Large-scale Outdoor Scene Rendering

2024-04-18 · Jingfeng Guo, Xiaohan Zhang, Baozhu Zhao, Qi Liu

Existing neural radiance fields (NeRF)-based novel view synthesis methods for large-scale outdoor scenes are mainly built on a single altitude. Moreover, they often require a priori camera shooting height and scene scope, leading to inefficient and impractical applications when camera altitude changes. In this work, we propose an end-to-end framework, termed AG-NeRF, and seek to reduce the training cost of building good reconstructions by synthesizing free-viewpoint images based on varying altitudes of scenes. Specifically, to tackle the detail variation problem from low altitude (drone-level) to high altitude (satellite-level), a source image selection method and an attention-based feature fusion approach are developed to extract and fuse the most relevant features of target view from multi-height images for high-fidelity rendering. Extensive experiments demonstrate that AG-NeRF achieves SOTA performance on 56 Leonard and Transamerica benchmarks and only requires a half hour of training time to reach the competitive PSNR as compared to the latest BungeeNeRF.

📄 PDF Abstract BibTeX arXiv:2404.11897

Code (1)

gjgjgjfff/AG-NeRF 공식 구현 pytorch

Tasks

NeRFNovel View Synthesis

Similar Papers 제목 키워드 기반

GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understanding

2024-03-06 · CVPR 2024 1 · Zi-Ting Chou, Sheng-Yu Huang, I-Jieh Liu, Yu-Chiang Frank Wang

Utilizing multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a popular research topic in 3D vision. In this work, we introduce a Generalizable Semantic Neural Radiance Field …

NeRFScene UnderstandingSemantic Segmentation

SeamlessNeRF: Stitching Part NeRFs with Gradient Propagation

2023-10-30 · Bingchen Gong, Yuehao Wang, Xiaoguang Han, Qi Dou

Neural Radiance Fields (NeRFs) have emerged as promising digital mediums of 3D objects and scenes, sparking a surge in research to extend the editing capabilities in this domain. The task of seamless editing and merging …

NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo

2021-09-02 · ICCV 2021 10 · Yi Wei, Shaohui Liu, Yongming Rao, Wang Zhao 외

In this work, we present a new multi-view depth estimation method that utilizes both conventional reconstruction and learning-based priors over the recently proposed neural radiance fields (NeRF). Unlike existing neural …

Depth EstimationNeRF

DReg-NeRF: Deep Registration for Neural Radiance Fields

2023-08-18 · ICCV 2023 1 · Yu Chen, Gim Hee Lee

Although Neural Radiance Fields (NeRF) is popular in the computer vision community recently, registering multiple NeRFs has yet to gain much attention. Unlike the existing work, NeRF2NeRF, which is based on traditional o…

NeRFNovel View SynthesisPoint Cloud RegistrationRTE

Removing Objects From Neural Radiance Fields

2022-12-22 · CVPR 2023 1 · Silvan Weder, Guillermo Garcia-Hernando, Aron Monszpart, Marc Pollefeys 외

Neural Radiance Fields (NeRFs) are emerging as a ubiquitous scene representation that allows for novel view synthesis. Increasingly, NeRFs will be shareable with other people. Before sharing a NeRF, though, it might be d…

Image InpaintingNeRFNovel View Synthesis