Uncertainty-aware Self-supervised 3D Data Association
3D object trackers usually require training on large amounts of annotated data that is expensive and time-consuming to collect. Instead, we propose leveraging vast unlabeled datasets by self-supervised metric learning of 3D object trackers, with a focus on data association. Large scale annotations for unlabeled data are cheaply obtained by automatic object detection and association across frames. We show how these self-supervised annotations can be used in a principled manner to learn point-cloud embeddings that are effective for 3D tracking. We estimate and incorporate uncertainty in self-supervised tracking to learn more robust embeddings, without needing any labeled data. We design embeddings to differentiate objects across frames, and learn them using uncertainty-aware self-supervised training. Finally, we demonstrate their ability to perform accurate data association across frames, towards effective and accurate 3D tracking. Project videos and code are at https://jianrenw.github.io/Self-Supervised-3D-Data-Association.
Code (1)
Tasks
Metric LearningObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Uncertainty-aware Unsupervised Multi-Object Tracking
Without manually annotated identities, unsupervised multi-object trackers are inferior to learning reliable feature embeddings. It causes the similarity-based inter-frame association stage also be error-prone, where an u…
Multi-Object TrackingObjectObject TrackingS$^3$Track: Self-supervised Tracking with Soft Assignment Flow
In this work, we study self-supervised multiple object tracking without using any video-level association labels. We propose to cast the problem of multiple object tracking as learning the frame-wise associations between…
Multiple Object TrackingObjectObject TrackingOptical Flow EstimationUncertainty-Aware Model Adaptation for Unsupervised Cross-Domain Object Detection
This work tackles the unsupervised cross-domain object detection problem which aims to generalize a pre-trained object detector to a new target domain without labels. We propose an uncertainty-aware model adaptation meth…
Domain AdaptationObjectobject-detectionObject DetectionSelf-Supervised Uncertainty Estimation For Super-Resolution of Satellite Images
Super-resolution (SR) of satellite imagery is challenging due to the lack of paired low-/high-resolution data. Recent self-supervised SR methods overcome this limitation by exploiting the temporal redundancy in burst obs…
Image Super-ResolutionImage ReconstructionDecentralized Gaussian Filters for Cooperative Self-localization and Multi-target Tracking
Scalable and decentralized algorithms for Cooperative Self-localization (CS) of agents, and Multi-Target Tracking (MTT) are important in many applications. In this work, we address the problem of Simultaneous Cooperative…