Learning regression and verification networks for long-term visual tracking
Compared with short-term tracking, the long-term tracking task requires determining the tracked object is present or absent, and then estimating the accurate bounding box if present or conducting image-wide re-detection if absent. Until now, few attempts have been done although this task is much closer to designing practical tracking systems. In this work, we propose a novel long-term tracking framework based on deep regression and verification networks. The offline-trained regression model is designed using the object-aware feature fusion and region proposal networks to generate a series of candidates and estimate their similarity scores effectively. The verification network evaluates these candidates to output the optimal one as the tracked object with its classification score, which is online updated to adapt to the appearance variations based on newly reliable observations. The similarity and classification scores are combined to obtain a final confidence value, based on which our tracker can determine the absence of the target accurately and conduct image-wide re-detection to capture the target successfully when it reappears. Extensive experiments show that our tracker achieves the best performance on the VOT2018 long-term challenge and state-of-the-art results on the OxUvA long-term dataset.
Code (3)
Tasks
General ClassificationObjectRegion ProposalregressionVisual TrackingSimilar Papers 제목 키워드 기반
CoCoLoT: Combining Complementary Trackers in Long-Term Visual Tracking
How to combine the complementary capabilities of an ensemble of different algorithms has been of central interest in visual object tracking. A significant progress on such a problem has been achieved, but considering sho…
Object TrackingVisual Object TrackingVisual TrackingRank-based verification for long-term face tracking in crowded scenes
Most current multi-object trackers focus on short-term tracking, and are based on deep and complex systems that often cannot operate in real-time, making them impractical for video-surveillance. In this paper we present …
Face DetectionFace RecognitionFace VerificationLong-Term Face Tracking for Crowded Video-Surveillance Scenarios
Most current multi-object trackers focus on short-term tracking, and are based on deep and complex systems that do not operate in real-time, often making them impractical for video-surveillance. In this paper, we present…
Face DetectionFace RecognitionFace VerificationSpatially Supervised Recurrent Convolutional Neural Networks for Visual Object Tracking
In this paper, we develop a new approach of spatially supervised recurrent convolutional neural networks for visual object tracking. Our recurrent convolutional network exploits the history of locations as well as the di…
Binary Classificationobject-detectionObject DetectionObject Tracking+2Long-term face tracking in the wild using deep learning
This paper investigates long-term face tracking of a specific person given his/her face image in a single frame as a query in a video stream. Through taking advantage of pre-trained deep learning models on big data, a no…
Deep LearningFace DetectionFace VerificationMetric Learning