Neural LiDAR Fields for Novel View Synthesis
We present Neural Fields for LiDAR (NFL), a method to optimise a neural field scene representation from LiDAR measurements, with the goal of synthesizing realistic LiDAR scans from novel viewpoints. NFL combines the rendering power of neural fields with a detailed, physically motivated model of the LiDAR sensing process, thus enabling it to accurately reproduce key sensor behaviors like beam divergence, secondary returns, and ray dropping. We evaluate NFL on synthetic and real LiDAR scans and show that it outperforms explicit reconstruct-then-simulate methods as well as other NeRF-style methods on LiDAR novel view synthesis task. Moreover, we show that the improved realism of the synthesized views narrows the domain gap to real scans and translates to better registration and semantic segmentation performance.
Code (0)
등록된 구현이 없습니다.
Tasks
NeRFNovel LiDAR View SynthesisNovel View SynthesisSemantic SegmentationSimilar Papers 제목 키워드 기반
LiDAR4D: Dynamic Neural Fields for Novel Space-time View LiDAR Synthesis
Although neural radiance fields (NeRFs) have achieved triumphs in image novel view synthesis (NVS), LiDAR NVS remains largely unexplored. Previous LiDAR NVS methods employ a simple shift from image NVS methods while igno…
3D Reconstruction4D reconstructionAutonomous DrivingDynamic Reconstruction+3Spectral-Geometric Neural Fields for Pose-Free LiDAR View Synthesis
Neural Radiance Fields (NeRF) have shown remarkable success in image novel view synthesis (NVS), inspiring extensions to LiDAR NVS. However, most methods heavily rely on accurate camera poses for scene reconstruction. Th…
Novel View SynthesisPC-NeRF: Parent-Child Neural Radiance Fields Using Sparse LiDAR Frames in Autonomous Driving Environments
Large-scale 3D scene reconstruction and novel view synthesis are vital for autonomous vehicles, especially utilizing temporally sparse LiDAR frames. However, conventional explicit representations remain a significant bot…
3D Reconstruction3D Scene ReconstructionAutonomous DrivingAutonomous Vehicles+3SN-LiDAR: Semantic Neural Fields for Novel Space-time View LiDAR Synthesis
Recent research has begun exploring novel view synthesis (NVS) for LiDAR point clouds, aiming to generate realistic LiDAR scans from unseen viewpoints. However, most existing approaches do not reconstruct semantic labels…
Autonomous DrivingNovel View SynthesisSemantic SegmentationGeoNLF: Geometry guided Pose-Free Neural LiDAR Fields
Although recent efforts have extended Neural Radiance Fields (NeRF) into LiDAR point cloud synthesis, the majority of existing works exhibit a strong dependence on precomputed poses. However, point cloud registration met…
NeRFNovel View SynthesisPoint Cloud RegistrationPose Estimation