High Performance Visual Tracking With Siamese Region Proposal Network
Visual object tracking has been a fundamental topic in recent years and many deep learning based trackers have achieved state-of-the-art performance on multiple benchmarks. However, most of these trackers can hardly get top performance with real-time speed. In this paper, we propose the Siamese region proposal network (Siamese-RPN) which is end-to-end trained off-line with large-scale image pairs. Specifically, it consists of Siamese subnetwork for feature extraction and region proposal subnetwork including the classification branch and regression branch. In the inference phase, the proposed framework is formulated as a local one-shot detection task. We can pre-compute the template branch of the Siamese subnetwork and formulate the correlation layers as trivial convolution layers to perform online tracking. Benefit from the proposal refinement, traditional multi-scale test and online fine-tuning can be discarded. The Siamese-RPN runs at 160 FPS while achieving leading performance in VOT2015, VOT2016 and VOT2017 real-time challenges.
Code (5)
Tasks
Object TrackingRegion ProposalVideo Object TrackingVisual Object TrackingVisual TrackingVocal Bursts Intensity PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SiamTHN: Siamese Target Highlight Network for Visual Tracking
Siamese network based trackers develop rapidly in the field of visual object tracking in recent years. The majority of siamese network based trackers now in use treat each channel in the feature maps generated by the bac…
Object TrackingregressionVisual Object TrackingVisual TrackingTwo stages for visual object tracking
Siamese-based trackers have achived promising performance on visual object tracking tasks. Most existing Siamese-based trackers contain two separate branches for tracking, including classification branch and bounding box…
Image SegmentationObjectObject TrackingSegmentation+4Siamese Natural Language Tracker: Tracking by Natural Language Descriptions with Siamese Trackers
We propose a novel Siamese Natural Language Tracker (SNLT), which brings the advancements in visual tracking to the tracking by natural language (NL) descriptions task. The proposed SNLT is applicable to a wide range of …
GPUObject TrackingRegion ProposalVisual Object Tracking+1Self-supervised Object Tracking with Cycle-consistent Siamese Networks
Self-supervised learning for visual object tracking possesses valuable advantages compared to supervised learning, such as the non-necessity of laborious human annotations and online training. In this work, we exploit an…
ObjectObject TrackingRegion ProposalSelf-Supervised Learning+4SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Tracking
By decomposing the visual tracking task into two subproblems as classification for pixel category and regression for object bounding box at this pixel, we propose a novel fully convolutional Siamese network to solve visu…
ClassificationGeneral ClassificationRegion Proposalregression+1