paper-with-me

홈 › Papers

Lightning NeRF: Efficient Hybrid Scene Representation for Autonomous Driving

2024-03-09 · Junyi Cao, Zhichao Li, Naiyan Wang, Chao Ma

Recent studies have highlighted the promising application of NeRF in autonomous driving contexts. However, the complexity of outdoor environments, combined with the restricted viewpoints in driving scenarios, complicates the task of precisely reconstructing scene geometry. Such challenges often lead to diminished quality in reconstructions and extended durations for both training and rendering. To tackle these challenges, we present Lightning NeRF. It uses an efficient hybrid scene representation that effectively utilizes the geometry prior from LiDAR in autonomous driving scenarios. Lightning NeRF significantly improves the novel view synthesis performance of NeRF and reduces computational overheads. Through evaluations on real-world datasets, such as KITTI-360, Argoverse2, and our private dataset, we demonstrate that our approach not only exceeds the current state-of-the-art in novel view synthesis quality but also achieves a five-fold increase in training speed and a ten-fold improvement in rendering speed. Codes are available at https://github.com/VISION-SJTU/Lightning-NeRF .

📄 PDF Abstract BibTeX arXiv:2403.05907

Code (1)

vision-sjtu/lightning-nerf 공식 구현 pytorch

Tasks

Autonomous DrivingNeRFNovel View Synthesis

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

HybridOcc: NeRF Enhanced Transformer-based Multi-Camera 3D Occupancy Prediction

2024-08-17 · Xiao Zhao, Bo Chen, Mingyang Sun, Dingkang Yang 외

Vision-based 3D semantic scene completion (SSC) describes autonomous driving scenes through 3D volume representations. However, the occlusion of invisible voxels by scene surfaces poses challenges to current SSC methods …

3D geometry3D Semantic Scene CompletionAutonomous DrivingNeRF

HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenes

2024-03-29 · Ke wu, Kaizhao Zhang, Zhiwei Zhang, Shanshuai Yuan 외

Online dense mapping of urban scenes forms a fundamental cornerstone for scene understanding and navigation of autonomous vehicles. Recent advancements in mapping methods are mainly based on NeRF, whose rendering speed i…

3DGSAutonomous VehiclesNeRFScene Understanding

Efficient Large-scale Scene Representation with a Hybrid of High-resolution Grid and Plane Features

2023-03-06 · Yuqi Zhang, GuanYing Chen, Shuguang Cui

Existing neural radiance fields (NeRF) methods for large-scale scene modeling require days of training using multiple GPUs, hindering their applications in scenarios with limited computing resources. Despite fast optimiz…

GPUNeRF

PC-NeRF: Parent-Child Neural Radiance Fields under Partial Sensor Data Loss in Autonomous Driving Environments

2023-10-02 · Xiuzhong Hu, Guangming Xiong, Zheng Zang, Peng Jia 외

Reconstructing large-scale 3D scenes is essential for autonomous vehicles, especially when partial sensor data is lost. Although the recently developed neural radiance fields (NeRF) have shown compelling results in impli…

3D Reconstruction3D Scene ReconstructionAutonomous DrivingAutonomous Vehicles+1

PC-NeRF: Parent-Child Neural Radiance Fields Using Sparse LiDAR Frames in Autonomous Driving Environments

2024-02-14 · Xiuzhong Hu, Guangming Xiong, Zheng Zang, Peng Jia 외

Large-scale 3D scene reconstruction and novel view synthesis are vital for autonomous vehicles, especially utilizing temporally sparse LiDAR frames. However, conventional explicit representations remain a significant bot…

3D Reconstruction3D Scene ReconstructionAutonomous DrivingAutonomous Vehicles+3