Weakly Supervised Class-Agnostic Motion Prediction for Autonomous Driving
Understanding the motion behavior of dynamic environments is vital for autonomous driving, leading to increasing attention in class-agnostic motion prediction in LiDAR point clouds. Outdoor scenes can often be decomposed into mobile foregrounds and static backgrounds, which enables us to associate motion understanding with scene parsing. Based on this observation, we study a novel weakly supervised motion prediction paradigm, where fully or partially (1%, 0.1%) annotated foreground/background binary masks rather than expensive motion annotations are used for supervision. To this end, we propose a two-stage weakly supervised approach, where the segmentation model trained with the incomplete binary masks in Stage1 will facilitate the self-supervised learning of the motion prediction network in Stage2 by estimating possible moving foregrounds in advance. Furthermore, for robust self-supervised motion learning, we design a Consistency-aware Chamfer Distance loss by exploiting multi-frame information and explicitly suppressing potential outliers. Comprehensive experiments show that, with fully or partially binary masks as supervision, our weakly supervised models surpass the self-supervised models by a large margin and perform on par with some supervised ones. This further demonstrates that our approach achieves a good compromise between annotation effort and performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous Drivingmotion predictionPredictionScene ParsingSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving
Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic mot…
Self-Supervised LearningAutonomous DrivingScene ParsingPoint CloudsSemi-Supervised Class-Agnostic Motion Prediction with Pseudo Label Regeneration and BEVMix
Class-agnostic motion prediction methods aim to comprehend motion within open-world scenarios, holding significance for autonomous driving systems. However, training a high-performance model in a fully-supervised manner …
Autonomous DrivingData Augmentationmotion predictionPseudo LabelPrior to Segment: Foreground Cues for Weakly Annotated Classes in Partially Supervised Instance Segmentation
Instance segmentation methods require large datasets with expensive and thus limited instance-level mask labels. Partially supervised instance segmentation aims to improve mask prediction with limited mask labels by util…
Instance SegmentationSegmentationSemantic SegmentationWeakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Images
Humans have a strong class-agnostic object segmentation ability and can outline boundaries of unknown objects precisely, which motivates us to propose a box-supervised class-agnostic object segmentation (BoxCaseg) based …
Box-supervised Instance SegmentationInstance SegmentationMulti-Task LearningObject+4Weakly Supervised Instance Segmentation for Videos with Temporal Mask Consistency
Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) parti…
Instance SegmentationRelation NetworkSegmentationSemantic Segmentation+1