Efficient Urban-scale Point Clouds Segmentation with BEV Projection
Point clouds analysis has grasped researchers' eyes in recent years, while 3D semantic segmentation remains a problem. Most deep point clouds models directly conduct learning on 3D point clouds, which will suffer from the severe sparsity and extreme data processing load in urban-scale data. To tackle the challenge, we propose to transfer the 3D point clouds to dense bird's-eye-view projection. In this case, the segmentation task is simplified because of class unbalance reduction and the feasibility of leveraging various 2D segmentation methods. We further design an attention-based fusion network that can conduct multi-modal learning on the projected images. Finally, the 2D out are remapped to generate 3D semantic segmentation results. To demonstrate the benefits of our method, we conduct various experiments on the SensatUrban dataset, in which our model presents competitive evaluation results (61.17% mIoU and 91.37% OverallAccuracy). We hope our work can inspire further exploration in point cloud analysis.
Code (1)
Tasks
3D Semantic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Toronto-3D: A Large-scale Mobile LiDAR Dataset for Semantic Segmentation of Urban Roadways
Semantic segmentation of large-scale outdoor point clouds is essential for urban scene understanding in various applications, especially autonomous driving and urban high-definition (HD) mapping. With rapid developments …
3D Semantic SegmentationAutonomous DrivingScene UnderstandingSegmentation+1OpenUrban3D: Annotation-Free Open-Vocabulary Semantic Segmentation of Large-Scale Urban Point Clouds
Open-vocabulary semantic segmentation enables models to recognize and segment objects from arbitrary natural language descriptions, offering the flexibility to handle novel, fine-grained, or functionally defined categori…
Point Cloud SegmentationSemantic SegmentationScene UnderstandingPoint CloudsAutomatic labelling of urban point clouds using data fusion
In this paper we describe an approach to semi-automatically create a labelled dataset for semantic segmentation of urban street-level point clouds. We use data fusion techniques using public data sources such as elevatio…
ManagementSegmentationSemantic SegmentationUrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentation
We present the UrbanBIS benchmark for large-scale 3D urban understanding, supporting practical urban-level semantic and building-level instance segmentation. UrbanBIS comprises six real urban scenes, with 2.5 billion poi…
3D ReconstructionAutonomous NavigationInstance SegmentationSemantic SegmentationCylinder3D: An Effective 3D Framework for Driving-scene LiDAR Semantic Segmentation
State-of-the-art methods for large-scale driving-scene LiDAR semantic segmentation often project and process the point clouds in the 2D space. The projection methods includes spherical projection, bird-eye view projectio…
3D Semantic SegmentationLIDAR Semantic SegmentationSemantic Segmentation