Semantic Segmentation-assisted Scene Completion for LiDAR Point Clouds

2021-09-23 · Xuemeng Yang, Hao Zou, Xin Kong, Tianxin Huang, Yong liu, Wanlong Li, Feng Wen, Hongbo Zhang

Outdoor scene completion is a challenging issue in 3D scene understanding, which plays an important role in intelligent robotics and autonomous driving. Due to the sparsity of LiDAR acquisition, it is far more complex for 3D scene completion and semantic segmentation. Since semantic features can provide constraints and semantic priors for completion tasks, the relationship between them is worth exploring. Therefore, we propose an end-to-end semantic segmentation-assisted scene completion network, including a 2D completion branch and a 3D semantic segmentation branch. Specifically, the network takes a raw point cloud as input, and merges the features from the segmentation branch into the completion branch hierarchically to provide semantic information. By adopting BEV representation and 3D sparse convolution, we can benefit from the lower operand while maintaining effective expression. Besides, the decoder of the segmentation branch is used as an auxiliary, which can be discarded in the inference stage to save computational consumption. Extensive experiments demonstrate that our method achieves competitive performance on SemanticKITTI dataset with low latency. Code and models will be released at https://github.com/jokester-zzz/SSA-SC.

📄 PDF Abstract BibTeX arXiv:2109.11453

Code (1)

jokester-zzz/ssa-sc 공식 구현 pytorch

Tasks

3D Semantic Scene Completion 3D Semantic Segmentation Autonomous Driving Decoder Scene Understanding Segmentation Semantic Segmentation

Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completion

2020-12-07 · Xu Yan, Jiantao Gao, Jie Li, Ruimao Zhang 외

LiDAR point cloud analysis is a core task for 3D computer vision, especially for autonomous driving. However, due to the severe sparsity and noise interference in the single sweep LiDAR point cloud, the accurate semantic…

3D Semantic Scene Completion 3D Semantic Scene Completion from a single RGB image 3D Semantic Segmentation Autonomous Driving+3

Scene Completeness-Aware Lidar Depth Completion for Driving Scenario

2020-03-15 · Cho-Ying Wu, Ulrich Neumann

This paper introduces Scene Completeness-Aware Depth Completion (SCADC) to complete raw lidar scans into dense depth maps with fine and complete scene structures. Recent sparse depth completion for lidars only focuses on…

Depth Completion RGBD Semantic Segmentation Scene Understanding Semantic Segmentation+2

Semantic Scene Completion using Local Deep Implicit Functions on LiDAR Data

2020-11-18 · Christoph B. Rist, David Emmerichs, Markus Enzweiler, Dariu M. Gavrila

Semantic scene completion is the task of jointly estimating 3D geometry and semantics of objects and surfaces within a given extent. This is a particularly challenging task on real-world data that is sparse and occluded.…

3D geometry 3D Semantic Scene Completion Scene Segmentation

PointSSC: A Cooperative Vehicle-Infrastructure Point Cloud Benchmark for Semantic Scene Completion

2023-09-22 · Yuxiang Yan, Boda Liu, Jianfei Ai, Qinbu Li 외

Semantic Scene Completion (SSC) aims to jointly generate space occupancies and semantic labels for complex 3D scenes. Most existing SSC models focus on volumetric representations, which are memory-inefficient for large o…

Point Cloud Completion Segmentation

S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Clouds

2020-12-16 · Ran Cheng, Christopher Agia, Yuan Ren, Xinhai Li 외

With the increasing reliance of self-driving and similar robotic systems on robust 3D vision, the processing of LiDAR scans with deep convolutional neural networks has become a trend in academia and industry alike. Prior…

3D Semantic Scene Completion Segmentation Semantic Segmentation