Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds
Deep learning approaches have made tremendous progress in the field of semantic segmentation over the past few years. However, most current approaches operate in the 2D image space. Direct semantic segmentation of unstructured 3D point clouds is still an open research problem. The recently proposed PointNet architecture presents an interesting step ahead in that it can operate on unstructured point clouds, achieving encouraging segmentation results. However, it subdivides the input points into a grid of blocks and processes each such block individually. In this paper, we investigate the question how such an architecture can be extended to incorporate larger-scale spatial context. We build upon PointNet and propose two extensions that enlarge the receptive field over the 3D scene. We evaluate the proposed strategies on challenging indoor and outdoor datasets and show improved results in both scenarios.
Code (1)
Tasks
3D Semantic SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CTNet: Context-based Tandem Network for Semantic Segmentation
Contextual information has been shown to be powerful for semantic segmentation. This work proposes a novel Context-based Tandem Network (CTNet) by interactively exploring the spatial contextual information and the channe…
SegmentationSemantic SegmentationExploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts
The rapid progress in 3D scene understanding has come with growing demand for data; however, collecting and annotating 3D scenes (e.g. point clouds) are notoriously hard. For example, the number of scenes (e.g. indoor ro…
3D Semantic SegmentationInstance SegmentationScene UnderstandingSegmentation+1Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation
We achieve 3D semantic scene labeling by exploring semantic relation between each point and its contextual neighbors through edges. Besides an encoder-decoder branch for predicting point labels, we construct an edge bran…
DecoderScene LabelingSemantic SegmentationSCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation
How to learn effective features from large-scale point clouds for semantic segmentation has attracted increasing attention in recent years. Addressing this problem, we propose a learnable module that learns Spatial C…
3D Semantic SegmentationDecoderPoint Cloud SegmentationSegmentation+1Semantic-guided modeling of spatial relation and object co-occurrence for indoor scene recognition
Exploring the semantic context in scene images is essential for indoor scene recognition. However, due to the diverse intra-class spatial layouts and the coexisting inter-class objects, modeling contextual relationships …
RelationScene RecognitionSemantic Segmentation