Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation
State-of-the-art methods for large-scale driving-scene LiDAR segmentation often project the point clouds to 2D space and then process them via 2D convolution. Although this corporation shows the competitiveness in the point cloud, it inevitably alters and abandons the 3D topology and geometric relations. A natural remedy is to utilize the3D voxelization and 3D convolution network. However, we found that in the outdoor point cloud, the improvement obtained in this way is quite limited. An important reason is the property of the outdoor point cloud, namely sparsity and varying density. Motivated by this investigation, we propose a new framework for the outdoor LiDAR segmentation, where cylindrical partition and asymmetrical 3D convolution networks are designed to explore the 3D geometric pat-tern while maintaining these inherent properties. Moreover, a point-wise refinement module is introduced to alleviate the interference of lossy voxel-based label encoding. We evaluate the proposed model on two large-scale datasets, i.e., SemanticKITTI and nuScenes. Our method achieves the 1st place in the leaderboard of SemanticKITTI and outperforms existing methods on nuScenes with a noticeable margin, about 4%. Furthermore, the proposed 3D framework also generalizes well to LiDAR panoptic segmentation and LiDAR 3D detection.
Code (2)
Tasks
3D Semantic SegmentationLIDAR Semantic SegmentationPanoptic SegmentationRobust 3D Semantic SegmentationSegmentationSemi-Supervised Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perception
State-of-the-art methods for driving-scene LiDAR-based perception (including point cloud semantic segmentation, panoptic segmentation and 3D detection, \etc) often project the point clouds to 2D space and then process th…
Panoptic SegmentationSegmentationSemantic SegmentationNUC-Net: Non-uniform Cylindrical Partition Network for Efficient LiDAR Semantic Segmentation
LiDAR semantic segmentation plays a vital role in autonomous driving. Existing voxel-based methods for LiDAR semantic segmentation apply uniform partition to the 3D LiDAR point cloud to form a structured representation b…
Autonomous DrivingGPULIDAR Semantic SegmentationSemantic SegmentationPointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Prediction
Semantic segmentation in autonomous driving has been undergoing an evolution from sparse point segmentation to dense voxel segmentation, where the objective is to predict the semantic occupancy of each voxel in the conce…
3D Semantic Occupancy PredictionAutonomous DrivingSegmentationSemantic SegmentationCylindrical Transform: 3D Semantic Segmentation of Kidneys With Limited Annotated Images
In this paper, we propose a novel technique for sampling sequential images using a cylindrical transform in a cylindrical coordinate system for kidney semantic segmentation in abdominal computed tomography (CT). The imag…
3D Semantic SegmentationComputed Tomography (CT)General ClassificationSegmentation+1The Devil is in the Details: Simple Remedies for Image-to-LiDAR Representation Learning
LiDAR is a crucial sensor in autonomous driving, commonly used alongside cameras. By exploiting this camera-LiDAR setup and recent advances in image representation learning, prior studies have shown the promising potenti…
3D Object Detection3D Semantic SegmentationAutonomous Drivingobject-detection+4