Siamese Instance Search for Tracking
In this paper we present a tracker, which is radically different from state-of-the-art trackers: we apply no model updating, no occlusion detection, no combination of trackers, no geometric matching, and still deliver state-of-the-art tracking performance, as demonstrated on the popular online tracking benchmark (OTB) and six very challenging YouTube videos. The presented tracker simply matches the initial patch of the target in the first frame with candidates in a new frame and returns the most similar patch by a learned matching function. The strength of the matching function comes from being extensively trained generically, i.e., without any data of the target, using a Siamese deep neural network, which we design for tracking. Once learned, the matching function is used as is, without any adapting, to track previously unseen targets. It turns out that the learned matching function is so powerful that a simple tracker built upon it, coined Siamese INstance search Tracker, SINT, which only uses the original observation of the target from the first frame, suffices to reach state-of-the-art performance. Further, we show the proposed tracker even allows for target re-identification after the target was absent for a complete video shot.
Code (0)
등록된 구현이 없습니다.
Tasks
Geometric MatchingInstance SearchSimilar Papers 제목 키워드 기반
SiamMOT: Siamese Multi-Object Tracking
In this paper, we focus on improving online multi-object tracking (MOT). In particular, we introduce a region-based Siamese Multi-Object Tracking network, which we name SiamMOT. SiamMOT includes a motion model that estim…
GPUMulti-Object TrackingObjectObject Tracking+1Multi-Object Tracking with Siamese Track-RCNN
Multi-object tracking systems often consist of a combination of a detector, a short term linker, a re-identification feature extractor and a solver that takes the output from these separate components and makes a final p…
Multi-Object TrackingObjectObject TrackingInteractive Instance Annotation with Siamese Networks
Annotating instance masks is time-consuming and labor-intensive. A promising solution is to predict contours using a deep learning model and then allow users to refine them. However, most existing methods focus on in-dom…
Object TrackingOne-Shot LearningRotation Equivariant Siamese Networks for Tracking
Rotation is among the long prevailing, yet still unresolved, hard challenges encountered in visual object tracking. The existing deep learning-based tracking algorithms use regular CNNs that are inherently translation eq…
2D Pose EstimationBenchmarkingObject TrackingPose Estimation+1F-Siamese Tracker: A Frustum-based Double Siamese Network for 3D Single Object Tracking
This paper presents F-Siamese Tracker, a novel approach for single object tracking prominently characterized by more robustly integrating 2D and 3D information to reduce redundant search space. A main challenge in 3D sin…
3D Single Object TrackingObjectObject Tracking