Learning Stixel-based Instance Segmentation
Stixels have been successfully applied to a wide range of vision tasks in autonomous driving, recently including instance segmentation. However, due to their sparse occurrence in the image, until now Stixels seldomly served as input for Deep Learning algorithms, restricting their utility for such approaches. In this work we present StixelPointNet, a novel method to perform fast instance segmentation directly on Stixels. By regarding the Stixel representation as unstructured data similar to point clouds, architectures like PointNet are able to learn features from Stixels. We use a bounding box detector to propose candidate instances, for which the relevant Stixels are extracted from the input image. On these Stixels, a PointNet models learns binary segmentations, which we then unify throughout the whole image in a final selection step. StixelPointNet achieves state-of-the-art performance on Stixel-level, is considerably faster than pixel-based segmentation methods, and shows that with our approach the Stixel domain can be introduced to many new 3D Deep Learning tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingInstance SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
StixelNExT++: Lightweight Monocular Scene Segmentation and Representation for Collective Perception
This paper presents StixelNExT++, a novel approach to scene representation for monocular perception systems. Building on the established Stixel representation, our method infers 3D Stixels and enhances object segmentatio…
Object SegmentationScene SegmentationMono-Stixels: Monocular depth reconstruction of dynamic street scenes
In this paper we present mono-stixels, a compact environment representation specially designed for dynamic street scenes. Mono-stixels are a novel approach to estimate stixels from a monocular camera sequence instead of …
Optical Flow EstimationSemantic SegmentationSlanted Stixels: A way to represent steep streets
This work presents and evaluates a novel compact scene representation based on Stixels that infers geometric and semantic information. Our approach overcomes the previous rather restrictive geometric assumptions for Stix…
StixelNExT: Toward Monocular Low-Weight Perception for Object Segmentation and Free Space Detection
In this work, we present a novel approach for general object segmentation from a monocular image, eliminating the need for manually labeled training data and enabling rapid, straightforward training and adaptation with m…
Semantic SegmentationSlanted Stixels: Representing San Francisco's Steepest Streets
In this work we present a novel compact scene representation based on Stixels that infers geometric and semantic information. Our approach overcomes the previous rather restrictive geometric assumptions for Stixels by in…