SN-LiDAR: Semantic Neural Fields for Novel Space-time View LiDAR Synthesis
Recent research has begun exploring novel view synthesis (NVS) for LiDAR point clouds, aiming to generate realistic LiDAR scans from unseen viewpoints. However, most existing approaches do not reconstruct semantic labels, which are crucial for many downstream applications such as autonomous driving and robotic perception. Unlike images, which benefit from powerful segmentation models, LiDAR point clouds lack such large-scale pre-trained models, making semantic annotation time-consuming and labor-intensive. To address this challenge, we propose SN-LiDAR, a method that jointly performs accurate semantic segmentation, high-quality geometric reconstruction, and realistic LiDAR synthesis. Specifically, we employ a coarse-to-fine planar-grid feature representation to extract global features from multi-frame point clouds and leverage a CNN-based encoder to extract local semantic features from the current frame point cloud. Extensive experiments on SemanticKITTI and KITTI-360 demonstrate the superiority of SN-LiDAR in both semantic and geometric reconstruction, effectively handling dynamic objects and large-scale scenes. Codes will be available on https://github.com/dtc111111/SN-Lidar.
Code (1)
Tasks
Autonomous DrivingNovel View SynthesisSemantic SegmentationSimilar Papers 제목 키워드 기반
LiDAR4D: Dynamic Neural Fields for Novel Space-time View LiDAR Synthesis
Although neural radiance fields (NeRFs) have achieved triumphs in image novel view synthesis (NVS), LiDAR NVS remains largely unexplored. Previous LiDAR NVS methods employ a simple shift from image NVS methods while igno…
3D Reconstruction4D reconstructionAutonomous DrivingDynamic Reconstruction+3Neural LiDAR Fields for Novel View Synthesis
We present Neural Fields for LiDAR (NFL), a method to optimise a neural field scene representation from LiDAR measurements, with the goal of synthesizing realistic LiDAR scans from novel viewpoints. NFL combines the rend…
NeRFNovel LiDAR View SynthesisNovel View SynthesisSemantic SegmentationMVLidarNet: Real-Time Multi-Class Scene Understanding for Autonomous Driving Using Multiple Views
Autonomous driving requires the inference of actionable information such as detecting and classifying objects, and determining the drivable space. To this end, we present Multi-View LidarNet (MVLidarNet), a two-stage dee…
Autonomous DrivingDecoderGPUobject-detection+2Transient Neural Radiance Fields for Lidar View Synthesis and 3D Reconstruction
Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth …
3D ReconstructionAutonomous DrivingNeRFCVCP-Fusion: On Implicit Depth Estimation for 3D Bounding Box Prediction
Combining LiDAR and Camera-view data has become a common approach for 3D Object Detection. However, previous approaches combine the two input streams at a point-level, throwing away semantic information derived from came…
3D Object DetectionDepth Estimationobject-detectionObject Detection