SpSequenceNet: Semantic Segmentation Network on 4D Point Clouds

2020-06-01 · CVPR 2020 6 · Hanyu Shi, Guosheng Lin, Hao Wang, Tzu-Yi Hung, Zhenhua Wang

Point clouds are useful in many applications like autonomous driving and robotics as they provide natural 3D information of the surrounding environments. While there are extensive research on 3D point clouds, scene understanding on 4D point clouds, a series of consecutive 3D point clouds frames, is an emerging topic and yet under-investigated. With 4D point clouds (3D point cloud videos), robotic systems could enhance their robustness by leveraging the temporal information from previous frames. However, the existing semantic segmentation methods on 4D point clouds suffer from low precision due to the spatial and temporal information loss in their network structures. In this paper, we propose SpSequenceNet to address this problem. The network is designed based on 3D sparse convolution. And we introduce two novel modules, a cross-frame global attention module and a cross-frame local interpolation module, to capture spatial and temporal information in 4D point clouds. We conduct extensive experiments on SemanticKITTI, and achieve the state-of-the-art result of 43.1% on mIoU, which is 1.5% higher than the previous best approach.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving Scene Understanding Semantic Segmentation

PointNLM: Point Nonlocal-Means for vegetation segmentation based on middle echo point clouds

2019-06-20 · Jonathan Li, Rongren Wu, Yiping Chen, Qing Zhu 외

Middle-echo, which covers one or a few corresponding points, is a specific type of 3D point cloud acquired by a multi-echo laser scanner. In this paper, we propose a novel approach for automatic segmentation of trees tha…

Point Cloud Segmentation Segmentation Semantic Segmentation

DLA-Net: Learning Dual Local Attention Features for Semantic Segmentation of Large-Scale Building Facade Point Clouds

2021-06-01 · Yanfei Su, Weiquan Liu, Zhimin Yuan, Ming Cheng 외

Semantic segmentation of building facade is significant in various applications, such as urban building reconstruction and damage assessment. As there is a lack of 3D point clouds datasets related to the fine-grained bui…

3D Semantic Segmentation Decoder Point Cloud Segmentation Segmentation+1

MNEW: Multi-domain Neighborhood Embedding and Weighting for Sparse Point Clouds Segmentation

2020-04-05 · Yang Zheng, Izzat H. Izzat, Sanling Song

Point clouds have been widely adopted in 3D semantic scene understanding. However, point clouds for typical tasks such as 3D shape segmentation or indoor scenario parsing are much denser than outdoor LiDAR sweeps for the…

Autonomous Driving Scene Understanding Semantic Segmentation

Generative Hard Example Augmentation for Semantic Point Cloud Segmentation

2025-01-01 · CVPR 2025 1 · Qi Zhang, Jibin Peng, Zhao Huang, Wei Feng 외

The recent progress in semantic point cloud segmentation is attributed to deep networks, which require a large amount of point cloud data for training. However, how to collect substantial point-wise annotations of th…

Point Cloud Segmentation Segmentation

Efficient Urban-scale Point Clouds Segmentation with BEV Projection

2021-09-19 · Zhenhong Zou, Yizhe Li

Point clouds analysis has grasped researchers' eyes in recent years, while 3D semantic segmentation remains a problem. Most deep point clouds models directly conduct learning on 3D point clouds, which will suffer from th…

3D Semantic Segmentation Segmentation Semantic Segmentation