Enhanced Object Tracking by Self-Supervised Auxiliary Depth Estimation Learning
RGB-D tracking significantly improves the accuracy of object tracking. However, its dependency on real depth inputs and the complexity involved in multi-modal fusion limit its applicability across various scenarios. The utilization of depth information in RGB-D tracking inspired us to propose a new method, named MDETrack, which trains a tracking network with an additional capability to understand the depth of scenes, through supervised or self-supervised auxiliary Monocular Depth Estimation learning. The outputs of MDETrack's unified feature extractor are fed to the side-by-side tracking head and auxiliary depth estimation head, respectively. The auxiliary module will be discarded in inference, thus keeping the same inference speed. We evaluated our models with various training strategies on multiple datasets, and the results show an improved tracking accuracy even without real depth. Through these findings we highlight the potential of depth estimation in enhancing object tracking performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationMonocular Depth EstimationObject TrackingSimilar Papers 제목 키워드 기반
YOLO11-JDE: Fast and Accurate Multi-Object Tracking with Self-Supervised Re-ID
We introduce YOLO11-JDE, a fast and accurate multi-object tracking (MOT) solution that combines real-time object detection with self-supervised Re-Identification (Re-ID). By incorporating a dedicated Re-ID branch into YO…
Multi-Object Trackingobject-detectionObject DetectionObject Tracking+2Improving Limited Labeled Dialogue State Tracking with Self-Supervision
Existing dialogue state tracking (DST) models require plenty of labeled data. However, collecting high-quality labels is costly, especially when the number of domains increases. In this paper, we address a practical DST …
Dialogue State TrackingWeakly Supervised Cross-Modal Learning for 4D Radar Scene Flow Estimation
Due to the difficulty of obtaining ground-truth data for 4D radar scene flow estimation, previous methods typically rely on either self-supervised losses or cross-modal supervision using 3D LiDAR data, 2D images, and odo…
3D Multi-Object TrackingScene Flow EstimationPoint CloudsUnleashing the Potential of Tracklets for Unsupervised Video Person Re-Identification
With rich temporal-spatial information, video-based person re-identification methods have shown broad prospects. Although tracklets can be easily obtained with ready-made tracking models, annotating identities is still e…
Person Re-IdentificationVideo-Based Person Re-IdentificationSelf-supervised Object Tracking with Cycle-consistent Siamese Networks
Self-supervised learning for visual object tracking possesses valuable advantages compared to supervised learning, such as the non-necessity of laborious human annotations and online training. In this work, we exploit an…
ObjectObject TrackingRegion ProposalSelf-Supervised Learning+4