Self-Supervised Learning of Lidar Segmentation for Autonomous Indoor Navigation
We present a self-supervised learning approach for the semantic segmentation of lidar frames. Our method is used to train a deep point cloud segmentation architecture without any human annotation. The annotation process is automated with the combination of simultaneous localization and mapping (SLAM) and ray-tracing algorithms. By performing multiple navigation sessions in the same environment, we are able to identify permanent structures, such as walls, and disentangle short-term and long-term movable objects, such as people and tables, respectively. New sessions can then be performed using a network trained to predict these semantic labels. We demonstrate the ability of our approach to improve itself over time, from one session to the next. With semantically filtered point clouds, our robot can navigate through more complex scenarios, which, when added to the training pool, help to improve our network predictions. We provide insights into our network predictions and show that our approach can also improve the performances of common localization techniques.
Code (2)
Tasks
NavigatePoint Cloud SegmentationSegmentationSelf-Supervised LearningSemantic SegmentationSimultaneous Localization and MappingSimilar Papers 제목 키워드 기반
Feasibility of Indoor Frame-Wise Lidar Semantic Segmentation via Distillation from Visual Foundation Model
Frame-wise semantic segmentation of indoor lidar scans is a fundamental step toward higher-level 3D scene understanding and mapping applications. However, acquiring frame-wise ground truth for training deep learning mode…
LIDAR Semantic SegmentationScene UnderstandingAutonomous DrivingImage-to-Lidar Self-Supervised Distillation for Autonomous Driving Data
Segmenting or detecting objects in sparse Lidar point clouds are two important tasks in autonomous driving to allow a vehicle to act safely in its 3D environment. The best performing methods in 3D semantic segmentation o…
3D Object Detection3D Semantic SegmentationAutonomous Drivingobject-detection+3LESS: Label-Efficient Semantic Segmentation for LiDAR Point Clouds
Semantic segmentation of LiDAR point clouds is an important task in autonomous driving. However, training deep models via conventional supervised methods requires large datasets which are costly to label. It is critical …
3D Semantic SegmentationAutonomous DrivingDescriptiveSegmentation+2Occupancy-MAE: Self-supervised Pre-training Large-scale LiDAR Point Clouds with Masked Occupancy Autoencoders
Current perception models in autonomous driving heavily rely on large-scale labelled 3D data, which is both costly and time-consuming to annotate. This work proposes a solution to reduce the dependence on labelled 3D tra…
3D Object Detection3D Semantic SegmentationAutonomous DrivingDomain Adaptation+8MILAN: Milli-Annotations for Lidar Semantic Segmentation
Annotating lidar point clouds for autonomous driving is a notoriously expensive and time-consuming task. In this work, we show that the quality of recent self-supervised lidar scan representations allows a great reductio…
Active LearningAutonomous DrivingLIDAR Semantic SegmentationSemantic Segmentation