Staged Depthwise Correlation and Feature Fusion for Siamese Object Tracking
In this work, we propose a novel staged depthwise correlation and feature fusion network, named DCFFNet, to further optimize the feature extraction for visual tracking. We build our deep tracker upon a siamese network architecture, which is offline trained from scratch on multiple large-scale datasets in an end-to-end manner. The model contains a core component, that is, depthwise correlation and feature fusion module (correlation-fusion module), which facilitates model to learn a set of optimal weights for a specific object by utilizing ensembles of multi-level features from lower and higher layers and multi-channel semantics on the same layer. We combine the modified ResNet-50 with the proposed correlation-fusion layer to constitute the feature extractor of our model. In training process, we find the training of model become more stable, that benifits from the correlation-fusion module. For comprehensive evaluations of performance, we implement our tracker on the popular benchmarks, including OTB100, VOT2018 and LaSOT. Extensive experiment results demonstrate that our proposed method achieves favorably competitive performance against many leading trackers in terms of accuracy and precision, while satisfying the real-time requirements of applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Object TrackingVisual TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LSNet: Extremely Light-Weight Siamese Network For Change Detection in Remote Sensing Image
The Siamese network is becoming the mainstream in change detection of remote sensing images (RSI). However, in recent years, the development of more complicated structure, module and training processe has resulted in the…
Change DetectionvalidTransformer Tracking
Correlation acts as a critical role in the tracking field, especially in recent popular Siamese-based trackers. The correlation operation is a simple fusion manner to consider the similarity between the template and the …
GPUObject TrackingVideo Object TrackingVisual Object Tracking+1High-Performance Transformer Tracking
Correlation has a critical role in the tracking field, especially in recent popular Siamese-based trackers. The correlation operation is a simple fusion method that considers the similarity between the template and the s…
Vocal Bursts Intensity PredictionSynthetic Aperture Radar Image Change Detection via Siamese Adaptive Fusion Network
Synthetic aperture radar (SAR) image change detection is a critical yet challenging task in the field of remote sensing image analysis. The task is non-trivial due to the following challenges: Firstly, intrinsic speckle …
Change Detection3D Siamese Transformer Network for Single Object Tracking on Point Clouds
Siamese network based trackers formulate 3D single object tracking as cross-correlation learning between point features of a template and a search area. Due to the large appearance variation between the template and sear…
3D Single Object TrackingObject Tracking