Spatio-Temporal Matching for Siamese Visual Tracking
Similarity matching is a core operation in Siamese trackers. Most Siamese trackers carry out similarity learning via cross correlation that originates from the image matching field. However, unlike 2-D image matching, the matching network in object tracking requires 4-D information (height, width, channel and time). Cross correlation neglects the information from channel and time dimensions, and thus produces ambiguous matching. This paper proposes a spatio-temporal matching process to thoroughly explore the capability of 4-D matching in space (height, width and channel) and time. In spatial matching, we introduce a space-variant channel-guided correlation (SVC-Corr) to recalibrate channel-wise feature responses for each spatial location, which can guide the generation of the target-aware matching features. In temporal matching, we investigate the time-domain context relations of the target and the background and develop an aberrance repressed module (ARM). By restricting the abrupt alteration in the interframe response maps, our ARM can clearly suppress aberrances and thus enables more robust and accurate object tracking. Furthermore, a novel anchor-free tracking framework is presented to accommodate these innovations. Experiments on challenging benchmarks including OTB100, VOT2018, VOT2020, GOT-10k, and LaSOT demonstrate the state-of-the-art performance of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Object TrackingVisual TrackingSimilar Papers 제목 키워드 기반
SiamMo: Siamese Motion-Centric 3D Object Tracking
Current 3D single object tracking methods primarily rely on the Siamese matching-based paradigm, which struggles with textureless and incomplete LiDAR point clouds. Conversely, the motion-centric paradigm avoids appearan…
3D Object Tracking3D Single Object TrackingMotion EstimationObject+1VideoTrack: Learning To Track Objects via Video Transformer
Existing Siamese tracking methods, which are built on pair-wise matching between two single frames, heavily rely on additional sophisticated mechanism to exploit temporal information among successive video frames, hi…
TripletVisual TrackingACTrack: Adding Spatio-Temporal Condition for Visual Object Tracking
Efficiently modeling spatio-temporal relations of objects is a key challenge in visual object tracking (VOT). Existing methods track by appearance-based similarity or long-term relation modeling, resulting in rich tempor…
ObjectObject TrackingVisual Object TrackingLearning by tracking: Siamese CNN for robust target association
This paper introduces a novel approach to the task of data association within the context of pedestrian tracking, by introducing a two-stage learning scheme to match pairs of detections. First, a Siamese convolutional ne…
Multiple People TrackingOptical Flow EstimationPositionAFAT: Adaptive Failure-Aware Tracker for Robust Visual Object Tracking
Siamese approaches have achieved promising performance in visual object tracking recently. The key to the success of Siamese trackers is to learn appearance-invariant feature embedding functions via pair-wise offline tra…
BenchmarkingObject TrackingOne-Shot LearningVisual Object Tracking