paper-with-me

홈 › Papers

BirdNeRF: Fast Neural Reconstruction of Large-Scale Scenes From Aerial Imagery

2024-02-07 · Huiqing Zhang, Yifei Xue, Ming Liao, Yizhen Lao

In this study, we introduce BirdNeRF, an adaptation of Neural Radiance Fields (NeRF) designed specifically for reconstructing large-scale scenes using aerial imagery. Unlike previous research focused on small-scale and object-centric NeRF reconstruction, our approach addresses multiple challenges, including (1) Addressing the issue of slow training and rendering associated with large models. (2) Meeting the computational demands necessitated by modeling a substantial number of images, requiring extensive resources such as high-performance GPUs. (3) Overcoming significant artifacts and low visual fidelity commonly observed in large-scale reconstruction tasks due to limited model capacity. Specifically, we present a novel bird-view pose-based spatial decomposition algorithm that decomposes a large aerial image set into multiple small sets with appropriately sized overlaps, allowing us to train individual NeRFs of sub-scene. This decomposition approach not only decouples rendering time from the scene size but also enables rendering to scale seamlessly to arbitrarily large environments. Moreover, it allows for per-block updates of the environment, enhancing the flexibility and adaptability of the reconstruction process. Additionally, we propose a projection-guided novel view re-rendering strategy, which aids in effectively utilizing the independently trained sub-scenes to generate superior rendering results. We evaluate our approach on existing datasets as well as against our own drone footage, improving reconstruction speed by 10x over classical photogrammetry software and 50x over state-of-the-art large-scale NeRF solution, on a single GPU with similar rendering quality.

📄 PDF Abstract BibTeX arXiv:2402.04554

Code (0)

등록된 구현이 없습니다.

Tasks

GPUNeRF

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction

2022-03-21 · CVPR 2022 1 · Xiaoshuai Zhang, Sai Bi, Kalyan Sunkavalli, Hao Su 외

While NeRF has shown great success for neural reconstruction and rendering, its limited MLP capacity and long per-scene optimization times make it challenging to model large-scale indoor scenes. In contrast, classical 3D…

3D ReconstructionNeRF

G3R: Gradient Guided Generalizable Reconstruction

2024-09-28 · Yun Chen, Jingkang Wang, Ze Yang, Sivabalan Manivasagam 외

Large scale 3D scene reconstruction is important for applications such as virtual reality and simulation. Existing neural rendering approaches (e.g., NeRF, 3DGS) have achieved realistic reconstructions on large scenes, b…

3DGS3D Scene ReconstructionNeRFNeural Rendering

CoSurfGS:Collaborative 3D Surface Gaussian Splatting with Distributed Learning for Large Scene Reconstruction

2024-12-23 · Yuanyuan Gao, Yalun Dai, Hao Li, Weicai Ye 외

3D Gaussian Splatting (3DGS) has demonstrated impressive performance in scene reconstruction. However, most existing GS-based surface reconstruction methods focus on 3D objects or limited scenes. Directly applying these …

3DGSGPUModel CompressionSurface Reconstruction

HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenes

2024-03-29 · Ke wu, Kaizhao Zhang, Zhiwei Zhang, Shanshuai Yuan 외

Online dense mapping of urban scenes forms a fundamental cornerstone for scene understanding and navigation of autonomous vehicles. Recent advancements in mapping methods are mainly based on NeRF, whose rendering speed i…

3DGSAutonomous VehiclesNeRFScene Understanding

UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflections

2023-12-20 · Fangjinhua Wang, Marie-Julie Rakotosaona, Michael Niemeyer, Richard Szeliski 외

Neural 3D scene representations have shown great potential for 3D reconstruction from 2D images. However, reconstructing real-world captures of complex scenes still remains a challenge. Existing generic 3D reconstruction…

3D ReconstructionNeRF