Multi Projection Fusion for Real-time Semantic Segmentation of 3D LiDAR Point Clouds
Semantic segmentation of 3D point cloud data is essential for enhanced high-level perception in autonomous platforms. Furthermore, given the increasing deployment of LiDAR sensors onboard of cars and drones, a special emphasis is also placed on non-computationally intensive algorithms that operate on mobile GPUs. Previous efficient state-of-the-art methods relied on 2D spherical projection of point clouds as input for 2D fully convolutional neural networks to balance the accuracy-speed trade-off. This paper introduces a novel approach for 3D point cloud semantic segmentation that exploits multiple projections of the point cloud to mitigate the loss of information inherent in single projection methods. Our Multi-Projection Fusion (MPF) framework analyzes spherical and bird's-eye view projections using two separate highly-efficient 2D fully convolutional models then combines the segmentation results of both views. The proposed framework is validated on the SemanticKITTI dataset where it achieved a mIoU of 55.5 which is higher than state-of-the-art projection-based methods RangeNet++ and PolarNet while being 1.6x faster than the former and 3.1x faster than the latter.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Semantic SegmentationLIDAR Semantic SegmentationReal-Time Semantic SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CPGNet: Cascade Point-Grid Fusion Network for Real-Time LiDAR Semantic Segmentation
LiDAR semantic segmentation essential for advanced autonomous driving is required to be accurate, fast, and easy-deployed on mobile platforms. Previous point-based or sparse voxel-based methods are far away from real-tim…
Autonomous DrivingLIDAR Semantic SegmentationRobust 3D Semantic SegmentationSemantic SegmentationSG-RIFE: Semantic-Guided Real-Time Intermediate Flow Estimation with Diffusion-Competitive Perceptual Quality
Real-time Video Frame Interpolation (VFI) has long been dominated by flow-based methods like RIFE, which offer high throughput but often fail in complicated scenarios involving large motion and occlusion. Conversely, rec…
parameter-efficient fine-tuningVideo Frame InterpolationAMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentation
In this paper, we present an Assertion-based Multi-View Fusion network (AMVNet) for LiDAR semantic segmentation which aggregates the semantic features of individual projection-based networks using late fusion. Given clas…
Autonomous VehiclesLIDAR Semantic SegmentationSemantic SegmentationElite360M: Efficient 360 Multi-task Learning via Bi-projection Fusion and Cross-task Collaboration
360 cameras capture the entire surrounding environment with a large FoV, exhibiting comprehensive visual information to directly infer the 3D structures, e.g., depth and surface normal, and semantic information simultane…
3D geometryERPMulti-Task LearningSemantic Segmentation+1Lights Out: A Nighttime UAV Localization Framework Using Thermal Imagery and Semantic 3D Maps
Reliable backup localization for unmanned aerial vehicles (UAVs) operating in GNSS-denied nighttime conditions remains an open challenge due to the severe modality gap between daytime RGB maps and nighttime thermal image…