MaskRange: A Mask-classification Model for Range-view based LiDAR Segmentation
Range-view based LiDAR segmentation methods are attractive for practical applications due to their direct inheritance from efficient 2D CNN architectures. In literature, most range-view based methods follow the per-pixel classification paradigm. Recently, in the image segmentation domain, another paradigm formulates segmentation as a mask-classification problem and has achieved remarkable performance. This raises an interesting question: can the mask-classification paradigm benefit the range-view based LiDAR segmentation and achieve better performance than the counterpart per-pixel paradigm? To answer this question, we propose a unified mask-classification model, MaskRange, for the range-view based LiDAR semantic and panoptic segmentation. Along with the new paradigm, we also propose a novel data augmentation method to deal with overfitting, context-reliance, and class-imbalance problems. Extensive experiments are conducted on the SemanticKITTI benchmark. Among all published range-view based methods, our MaskRange achieves state-of-the-art performance with $66.10$ mIoU on semantic segmentation and promising results with $53.10$ PQ on panoptic segmentation with high efficiency. Our code will be released.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationData AugmentationImage SegmentationPanoptic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editing
Training autonomous driving and navigation systems requires large and diverse point cloud datasets that capture complex edge case scenarios from various dynamic urban settings. Acquiring such diverse scenarios from real-…
Point Cloud GenerationAutonomous DrivingPoint CloudsWhat Matters in Range View 3D Object Detection
Lidar-based perception pipelines rely on 3D object detection models to interpret complex scenes. While multiple representations for lidar exist, the range-view is enticing since it losslessly encodes the entire lidar sen…
3D Object DetectionObjectobject-detectionObject DetectionMaskedFusion360: Reconstruct LiDAR Data by Querying Camera Features
In self-driving applications, LiDAR data provides accurate information about distances in 3D but lacks the semantic richness of camera data. Therefore, state-of-the-art methods for perception in urban scenes fuse data fr…
Sensor FusionUP-Fuse: Uncertainty-guided LiDAR-Camera Fusion for 3D Panoptic Segmentation
LiDAR-camera fusion enhances 3D panoptic segmentation by leveraging camera images to complement sparse LiDAR scans, but it also introduces a critical failure mode. Under adverse conditions, degradation or failure of the …
Panoptic SegmentationPerson Segmentation and Action Classification for Multi-Channel Hemisphere Field of View LiDAR Sensors
Robots need to perceive persons in their surroundings for safety and to interact with them. In this paper, we present a person segmentation and action classification approach that operates on 3D scans of hemisphere field…
Action ClassificationSegmentation