Efficient 3D Semantic Segmentation with Superpoint Transformer
We introduce a novel superpoint-based transformer architecture for efficient semantic segmentation of large-scale 3D scenes. Our method incorporates a fast algorithm to partition point clouds into a hierarchical superpoint structure, which makes our preprocessing 7 times faster than existing superpoint-based approaches. Additionally, we leverage a self-attention mechanism to capture the relationships between superpoints at multiple scales, leading to state-of-the-art performance on three challenging benchmark datasets: S3DIS (76.0% mIoU 6-fold validation), KITTI-360 (63.5% on Val), and DALES (79.6%). With only 212k parameters, our approach is up to 200 times more compact than other state-of-the-art models while maintaining similar performance. Furthermore, our model can be trained on a single GPU in 3 hours for a fold of the S3DIS dataset, which is 7x to 70x fewer GPU-hours than the best-performing methods. Our code and models are accessible at github.com/drprojects/superpoint_transformer.
Code (1)
Tasks
3D Semantic SegmentationGPUSemantic SegmentationSimilar Papers 제목 키워드 기반
Superpoint Transformer for 3D Scene Instance Segmentation
Most existing methods realize 3D instance segmentation by extending those models used for 3D object detection or 3D semantic segmentation. However, these non-straightforward methods suffer from two drawbacks: 1) Imprecis…
3D Instance Segmentation3D Object Detection3D Semantic SegmentationDecoder+5EZ-SP: Fast and Lightweight Superpoint-Based 3D Segmentation
Superpoint-based pipelines provide an efficient alternative to point- or voxel-based 3D semantic segmentation, but are often bottlenecked by their CPU-bound partition step. We propose a learnable, fully GPU partitioning …
3D Semantic SegmentationAutonomous DrivingSSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Network
Point cloud semantic segmentation is a crucial task in 3D scene understanding. Existing methods mainly focus on employing a large number of annotated labels for supervised semantic segmentation. Nonetheless, manually lab…
Point Cloud SegmentationScene UnderstandingSegmentationSemantic SegmentationEfficient LiDAR Point Cloud Oversegmentation Network
Point cloud oversegmentation is a challenging task since it needs to produce perceptually meaningful partitions (i.e., superpoints) of a point cloud. Most existing oversegmentation methods cannot efficiently generate…
LIDAR Semantic SegmentationSemantic SegmentationGeneralizable Articulated Object Perception with Superpoints
Manipulating articulated objects with robotic arms is challenging due to the complex kinematic structure, which requires precise part segmentation for efficient manipulation. In this work, we introduce a novel superpoint…
DecoderObjectSegmentation