Gap Completion in Point Cloud Scene occluded by Vehicles using SGC-Net
Recent advances in mobile mapping systems have greatly enhanced the efficiency and convenience of acquiring urban 3D data. These systems utilize LiDAR sensors mounted on vehicles to capture vast cityscapes. However, a significant challenge arises due to occlusions caused by roadside parked vehicles, leading to the loss of scene information, particularly on the roads, sidewalks, curbs, and the lower sections of buildings. In this study, we present a novel approach that leverages deep neural networks to learn a model capable of filling gaps in urban scenes that are obscured by vehicle occlusion. We have developed an innovative technique where we place virtual vehicle models along road boundaries in the gap-free scene and utilize a ray-casting algorithm to create a new scene with occluded gaps. This allows us to generate diverse and realistic urban point cloud scenes with and without vehicle occlusion, surpassing the limitations of real-world training data collection and annotation. Furthermore, we introduce the Scene Gap Completion Network (SGC-Net), an end-to-end model that can generate well-defined shape boundaries and smooth surfaces within occluded gaps. The experiment results reveal that 97.66% of the filled points fall within a range of 5 centimeters relative to the high-density ground truth point cloud scene. These findings underscore the efficacy of our proposed model in gap completion and reconstructing urban scenes affected by vehicle occlusions.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Semantic Point Completion Network for 3D Semantic Scene Completion
Semantic scene completion (SSC) is composed of scene completion (SC) and semantic segmentation. Most of the existing methods carry out SSC in a regular 3D grid space, where 3D CNNs cause unnecessary computational cost…
3D Semantic Scene CompletionDecoderSemantic SegmentationSelf-supervised Point Cloud Completion on Real Traffic Scenes via Scene-concerned Bottom-up Mechanism
Real scans always miss partial geometries of objects due to the self-occlusions, external-occlusions, and limited sensor resolutions. Point cloud completion aims to refer the complete shapes for incomplete 3D scans of ob…
Point Cloud CompletionAPC2Mesh: Bridging the gap from occluded building façades to full 3D models
The benefits of having digital twins of urban buildings are numerous. However, a major difficulty encountered in their creation from airborne LiDAR point clouds is the effective means of accurately reconstructing signifi…
3D Point Cloud Reconstruction3D ReconstructionPoint cloud reconstructionPoint Cloud Scene Completion with Joint Color and Semantic Estimation from Single RGB-D Image
We present a deep reinforcement learning method of progressive view inpainting for colored semantic point cloud scene completion under volume guidance, achieving high-quality scene reconstruction from only a single RGB-D…
Deep Reinforcement LearningImage InpaintingSegmentationSemantic SegmentationDiffSSC: Semantic LiDAR Scan Completion using Denoising Diffusion Probabilistic Models
Perception systems play a crucial role in autonomous driving, incorporating multiple sensors and corresponding computer vision algorithms. 3D LiDAR sensors are widely used to capture sparse point clouds of the vehicle's …
Autonomous DrivingDenoisingImage GenerationSuper-Resolution