DSNet: Deep and Shallow Feature Learning for Efficient Visual Tracking
In recent years, Discriminative Correlation Filter (DCF) based tracking methods have achieved great success in visual tracking. However, the multi-resolution convolutional feature maps trained from other tasks like image classification, cannot be naturally used in the conventional DCF formulation. Furthermore, these high-dimensional feature maps significantly increase the tracking complexity and thus limit the tracking speed. In this paper, we present a deep and shallow feature learning network, namely DSNet, to learn the multi-level same-resolution compressed (MSC) features for efficient online tracking, in an end-to-end offline manner. Specifically, the proposed DSNet compresses multi-level convolutional features to uniform spatial resolution features. The learned MSC features effectively encode both appearance and semantic information of objects in the same-resolution feature maps, thus enabling an elegant combination of the MSC features with any DCF-based methods. Additionally, a channel reliability measurement (CRM) method is presented to further refine the learned MSC features. We demonstrate the effectiveness of the MSC features learned from the proposed DSNet on two DCF tracking frameworks: the basic DCF framework and the continuous convolution operator framework. Extensive experiments show that the learned MSC features have the appealing advantage of allowing the equipped DCF-based tracking methods to perform favorably against the state-of-the-art methods while running at high frame rates.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationVisual TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DSNet: A Novel Way to Use Atrous Convolutions in Semantic Segmentation
Atrous convolutions are employed as a method to increase the receptive field in semantic segmentation tasks. However, in previous works of semantic segmentation, it was rarely employed in the shallow layers of the model.…
Real-Time Semantic SegmentationSemantic SegmentationParallel Multi-Scale Networks with Deep Supervision for Hand Keypoint Detection
Keypoint detection plays an important role in a wide range of applications. However, predicting keypoints of small objects such as human hands is a challenging problem. Recent works fuse feature maps of deep Convolutiona…
Keypoint DetectionBindsNET: A machine learning-oriented spiking neural networks library in Python
The development of spiking neural network simulation software is a critical component enabling the modeling of neural systems and the development of biologically inspired algorithms. Existing software frameworks support …
BIG-bench Machine LearningCPUGPUNeural Network simulation+4Frequency-Enhanced Dual-Subspace Networks for Few-Shot Fine-Grained Image Classification
Few-shot fine-grained image classification aims to recognize subcategories with high visual similarity using only a limited number of annotated samples. Existing metric learning-based methods typically rely solely on spa…
Fine-Grained Image ClassificationFine-Grained Visual RecognitionComputational EfficiencyMetric LearningDSNet for Real-Time Driving Scene Semantic Segmentation
We focus on the very challenging task of semantic segmentation for autonomous driving system. It must deliver decent semantic segmentation result for traffic critical objects real-time. In this paper, we propose a very e…
Autonomous DrivingDecision MakingSegmentationSemantic Segmentation