StreamMOS: Streaming Moving Object Segmentation with Multi-View Perception and Dual-Span Memory
Moving object segmentation based on LiDAR is a crucial and challenging task for autonomous driving and mobile robotics. Most approaches explore spatio-temporal information from LiDAR sequences to predict moving objects in the current frame. However, they often focus on transferring temporal cues in a single inference and regard every prediction as independent of others. This may cause inconsistent segmentation results for the same object in different frames. To overcome this issue, we propose a streaming network with a memory mechanism, called StreamMOS, to build the association of features and predictions among multiple inferences. Specifically, we utilize a short-term memory to convey historical features, which can be regarded as spatial prior of moving objects and adopted to enhance current inference by temporal fusion. Meanwhile, we build a long-term memory to store previous predictions and exploit them to refine the present forecast at voxel and instance levels through voting. Besides, we present multi-view encoder with cascade projection and asymmetric convolution to extract motion feature of objects in different representations. Extensive experiments validate that our algorithm gets competitive performance on SemanticKITTI and Sipailou Campus datasets. Code will be released at https://github.com/NEU-REAL/StreamMOS.git.
Code (1)
Tasks
Autonomous DrivingSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GMOS: Grounding Moving Object Segmentation in 3D Space and Time
Moving Object Segmentation (MOS) aims to discover, segment, and track objects that move independently of the camera. Current MOS methods, however, exhibit two fundamental limitations: they rely on pre-computed 2D auxilia…
Video Object SegmentationMotionRec: A Unified Deep Framework for Moving Object Recognition
In this paper we present a novel deep learning framework to perform online moving object recognition(MOR) in streaming videos. The existing methods for moving object detection (MOD) only computes class-agnostic pixel-wis…
Moving Object Detectionobject-detectionObject DetectionObject RecognitionSemantics-Guided Moving Object Segmentation with 3D LiDAR
Moving object segmentation (MOS) is a task to distinguish moving objects, e.g., moving vehicles and pedestrians, from the surrounding static environment. The segmentation accuracy of MOS can have an influence on odometry…
ObjectSegmentationSemantic SegmentationLearning to Segment Moving Objects in Videos
We segment moving objects in videos by ranking spatio-temporal segment proposals according to "moving objectness": how likely they are to contain a moving object. In each video frame, we compute segment proposals using m…
SegmentationVideo SegmentationVideo Semantic SegmentationMovSAM: A Single-image Moving Object Segmentation Framework Based on Deep Thinking
Moving object segmentation plays a vital role in understanding dynamic visual environments. While existing methods rely on multi-frame image sequences to identify moving objects, single-image MOS is critical for applicat…
Autonomous DrivingLanguage ModelingLanguage ModellingLarge Language Model+6