paper-with-me

홈 › Papers

Low Latency Instance Segmentation by Continuous Clustering for LiDAR Sensors

2023-11-23 · Andreas Reich, Mirko Maehlisch

Low-latency instance segmentation of LiDAR point clouds is crucial in real-world applications because it serves as an initial and frequently-used building block in a robot's perception pipeline, where every task adds further delay. Particularly in dynamic environments, this total delay can result in significant positional offsets of dynamic objects, as seen in highway scenarios. To address this issue, we employ a new technique, which we call continuous clustering. Unlike most existing clustering approaches, which use a full revolution of the LiDAR sensor, we process the data stream in a continuous and seamless fashion. Our approach does not rely on the concept of complete or partial sensor rotations with multiple discrete range images; instead, it views the range image as a single and infinitely horizontally growing entity. Each new column of this continuous range image is processed as soon it is available. Obstacle points are clustered to existing instances in real-time and it is checked at a high-frequency which instances are completed in order to publish them without waiting for the completion of the revolution or some other integration period. In the case of rotating sensors, no problematic discontinuities between the points of the end and the start of a scan are observed. In this work we describe the two-layered data structure and the corresponding algorithm for continuous clustering. It is able to achieve an average latency of just 5 ms with respect to the latest timestamp of all points in the cluster. We are publishing the source code at https://github.com/UniBwTAS/continuous_clustering.

📄 PDF Abstract BibTeX arXiv:2311.13976

Code (1)

unibwtas/continuous_clustering 공식 구현

Tasks

ClusteringInstance SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

ElC-OIS: Ellipsoidal Clustering for Open-World Instance Segmentation on LiDAR Data

2023-03-08 · Wenbang Deng, Kaihong Huang, Qinghua Yu, Huimin Lu 외

Open-world Instance Segmentation (OIS) is a challenging task that aims to accurately segment every object instance appearing in the current observation, regardless of whether these instances have been labeled in the trai…

Autonomous NavigationClusteringInstance SegmentationOpen-World Instance Segmentation+3

LiDAR-based 4D Panoptic Segmentation via Dynamic Shifting Network

2022-03-14 · Fangzhou Hong, Hui Zhou, Xinge Zhu, Hongsheng Li 외

With the rapid advances of autonomous driving, it becomes critical to equip its sensing system with more holistic 3D perception. However, existing works focus on parsing either the objects (e.g. cars and pedestrians) or …

4D Panoptic SegmentationAutonomous DrivingClusteringPanoptic Segmentation+1

CPSeg: Cluster-free Panoptic Segmentation of 3D LiDAR Point Clouds

2021-11-02 · Enxu Li, Ryan Razani, YiXuan Xu, Bingbing Liu

A fast and accurate panoptic segmentation system for LiDAR point clouds is crucial for autonomous driving vehicles to understand the surrounding objects and scenes. Existing approaches usually rely on proposals or cluste…

Autonomous DrivingClusteringDecoderDepth Completion+4

SMAC-Seg: LiDAR Panoptic Segmentation via Sparse Multi-directional Attention Clustering

2021-08-31 · Enxu Li, Ryan Razani, YiXuan Xu, Liu Bingbing

Panoptic segmentation aims to address semantic and instance segmentation simultaneously in a unified framework. However, an efficient solution of panoptic segmentation in applications like autonomous driving is still an …

Autonomous DrivingClusteringInstance SegmentationPanoptic Segmentation+4

LiDAR-based Panoptic Segmentation via Dynamic Shifting Network

2020-11-24 · CVPR 2021 1 · Fangzhou Hong, Hui Zhou, Xinge Zhu, Hongsheng Li 외

With the rapid advances of autonomous driving, it becomes critical to equip its sensing system with more holistic 3D perception. However, existing works focus on parsing either the objects (e.g. cars and pedestrians) or …

Autonomous DrivingClusteringPanoptic Segmentation