Trainable Pointwise Decoder Module for Point Cloud Segmentation
Point cloud segmentation (PCS) aims to make per-point predictions and enables robots and autonomous driving cars to understand the environment. The range image is a dense representation of a large-scale outdoor point cloud, and segmentation models built upon the image commonly execute efficiently. However, the projection of the point cloud onto the range image inevitably leads to dropping points because, at each image coordinate, only one point is kept despite multiple points being projected onto the same location. More importantly, it is challenging to assign correct predictions to the dropped points that belong to the classes different from the kept point class. Besides, existing post-processing methods, such as K-nearest neighbor (KNN) search and kernel point convolution (KPConv), cannot be trained with the models in an end-to-end manner or cannot process varying-density outdoor point clouds well, thereby enabling the models to achieve sub-optimal performance. To alleviate this problem, we propose a trainable pointwise decoder module (PDM) as the post-processing approach, which gathers weighted features from the neighbors and then makes the final prediction for the query point. In addition, we introduce a virtual range image-guided copy-rotate-paste (VRCrop) strategy in data augmentation. VRCrop constrains the total number of points and eliminates undesirable artifacts in the augmented point cloud. With PDM and VRCrop, existing range image-based segmentation models consistently perform better than their counterparts on the SemanticKITTI, SemanticPOSS, and nuScenes datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingData AugmentationDecoderPoint Cloud SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Point Attention Network for Semantic Segmentation of 3D Point Clouds
Convolutional Neural Networks (CNNs) have performed extremely well on data represented by regularly arranged grids such as images. However, directly leveraging the classic convolution kernels or parameter sharing mechani…
DecoderPoint Cloud SegmentationSemantic SegmentationMVP-Net: Multiple View Pointwise Semantic Segmentation of Large-Scale Point Clouds
Semantic segmentation of 3D point cloud is an essential task for autonomous driving environment perception. The pipeline of most pointwise point cloud semantic segmentation methods includes points sampling, neighbor sear…
Autonomous DrivingSegmentationSemantic SegmentationMapping in a cycle: Sinkhorn regularized unsupervised learning for point cloud shapes
We propose an unsupervised learning framework with the pretext task of finding dense correspondences between point cloud shapes from the same category based on the cycle-consistency formulation. In order to learn discrim…
TripletPointwise Attention-Based Atrous Convolutional Neural Networks
With the rapid progress of deep convolutional neural networks, in almost all robotic applications, the availability of 3D point clouds improves the accuracy of 3D semantic segmentation methods. Rendering of these irregul…
3D Semantic SegmentationSegmentationSemantic Segmentation6D-ViT: Category-Level 6D Object Pose Estimation via Transformer-based Instance Representation Learning
This paper presents 6D-ViT, a transformer-based instance representation learning network, which is suitable for highly accurate category-level object pose estimation on RGB-D images. Specifically, a novel two-stream enco…
6D Pose Estimation using RGBDecoderPose EstimationRepresentation Learning