Self-Supervised Multi-Object Tracking For Autonomous Driving From Consistency Across Timescales
Self-supervised multi-object trackers have tremendous potential as they enable learning from raw domain-specific data. However, their re-identification accuracy still falls short compared to their supervised counterparts. We hypothesize that this drawback results from formulating self-supervised objectives that are limited to single frames or frame pairs. Such formulations do not capture sufficient visual appearance variations to facilitate learning consistent re-identification features for autonomous driving when the frame rate is low or object dynamics are high. In this work, we propose a training objective that enables self-supervised learning of re-identification features from multiple sequential frames by enforcing consistent association scores across short and long timescales. We perform extensive evaluations demonstrating that re-identification features trained from longer sequences significantly reduce ID switches on standard autonomous driving datasets compared to existing self-supervised learning methods, which are limited to training on frame pairs. Using our proposed SubCo loss function, we set the new state-of-the-art among self-supervised methods and even perform on par with fully supervised learning methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingMulti-Object TrackingObject TrackingSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Learning to Track Instance from Single Nature Language Description
How to achieve vision-language (VL) tracking using natural language descriptions from a video sequence \textbf{without relying on any bounding-box ground truth}? In this work, we achieve this goal by tackling \textit{sel…
Self-Supervised LearningMulti-object tracking with self-supervised associating network
Multi-Object Tracking (MOT) is the task that has a lot of potential for development, and there are still many problems to be solved. In the traditional tracking by detection paradigm, There has been a lot of work on feat…
Multi-Object TrackingObjectObject TrackingSelf-Supervised LearningSelf-supervised Object Tracking with Cycle-consistent Siamese Networks
Self-supervised learning for visual object tracking possesses valuable advantages compared to supervised learning, such as the non-necessity of laborious human annotations and online training. In this work, we exploit an…
ObjectObject TrackingRegion ProposalSelf-Supervised Learning+4Large-Scale Object Discovery and Detector Adaptation from Unlabeled Video
We explore object discovery and detector adaptation based on unlabeled video sequences captured from a mobile platform. We propose a fully automatic approach for object mining from video which builds upon a generic objec…
Autonomous DrivingClusteringObjectObject Discovery+1Self-Supervised Pre-training with Combined Datasets for 3D Perception in Autonomous Driving
The significant achievements of pre-trained models leveraging large volumes of data in the field of NLP and 2D vision inspire us to explore the potential of extensive data pre-training for 3D perception in autonomous dri…
3D Object Detection3D Object TrackingAutonomous DrivingBEV Segmentation+4