Transferring Rich Feature Hierarchies for Robust Visual Tracking
Convolutional neural network (CNN) models have demonstrated great success in various computer vision tasks including image classification and object detection. However, some equally important tasks such as visual tracking remain relatively unexplored. We believe that a major hurdle that hinders the application of CNN to visual tracking is the lack of properly labeled training data. While existing applications that liberate the power of CNN often need an enormous amount of training data in the order of millions, visual tracking applications typically have only one labeled example in the first frame of each video. We address this research issue here by pre-training a CNN offline and then transferring the rich feature hierarchies learned to online tracking. The CNN is also fine-tuned during online tracking to adapt to the appearance of the tracked target specified in the first video frame. To fit the characteristics of object tracking, we first pre-train the CNN to recognize what is an object, and then propose to generate a probability map instead of producing a simple class label. Using two challenging open benchmarks for performance evaluation, our proposed tracker has demonstrated substantial improvement over other state-of-the-art trackers.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationObjectobject-detectionObject DetectionObject TrackingVisual TrackingSimilar Papers 제목 키워드 기반
Differentiating Objects by Motion: Joint Detection and Tracking of Small Flying Objects
While generic object detection has achieved large improvements with rich feature hierarchies from deep nets, detecting small objects with poor visual cues remains challenging. Motion cues from multiple frames may be more…
Objectobject-detectionObject DetectionOpen-Ended Question Answering+1Hierarchical Convolutional Features for Visual Tracking
Visual object tracking is challenging as target objects often undergo significant appearance changes caused by deformation, abrupt motion, background clutter and occlusion. In this paper, we exploit features extracted fr…
Object RecognitionObject TrackingVisual Object TrackingVisual TrackingDeep Tracking: Visual Tracking Using Deep Convolutional Networks
In this paper, we study a discriminatively trained deep convolutional network for the task of visual tracking. Our tracker utilizes both motion and appearance features that are extracted from a pre-trained dual stream de…
Visual TrackingSTCT: Sequentially Training Convolutional Networks for Visual Tracking
Due to the limited amount of training samples, fine-tuning pre-trained deep models online is prone to over-fitting. In this paper, we propose a sequential training method for convolutional neural networks (CNNs) to effec…
Visual TrackingMulti-Granularity Mutual Refinement Network for Zero-Shot Learning
Zero-shot learning (ZSL) aims to recognize unseen classes with zero samples by transferring semantic knowledge from seen classes. Current approaches typically correlate global visual features with semantic information (i…
Zero-Shot Learning