Object Tracking Using Siamese Network-Based Reinforcement Learning
Object tracking is a technique for tracking a specific object appearing in a video sequence while observing its features or changes. Recently, many algorithms showing high performance have emerged by applying the Siamese network to the object tracking field. A Siamese network is designed to learn the similarity between two images. In object tracking, the Siamese network tracks the object by finding the location most similar to the target image in the search image. Algorithms based on Siamese networks are vulnerable to partial and total occlusion of objects. In addition, since the object is tracked using only the similarity with the image obtained using the ground-truth bounding box of the first frame, if an object is missed once, then errors are accumulated, and a situation where the object drifts away from the object of interest frequently occurs. Therefore, in this paper, we propose a reinforcement learning model that can maximize the reward for tracking success after partial and total occlusion of an object. We also propose a dynamic template exchange method using a template that has been successfully tracked in a recent frame to solve the drift problem. When the proposed model is applied to the existing tracking models to evaluate the quantitative performance in representative object tracking benchmarks VOT2018 and OTB50, it is confirmed that the accuracy is improved, and the number of tracking failures decreases compared to the existing method. As a result, an accuracy of 0.618, robustness of 0.234, and expected average overlap (EAO) of 0.416 are achieved in VOT2018, and success of 0.673 and precision of 0.881 are achieved in OTB50.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject Trackingreinforcement-learningReinforcement LearningVisual Object TrackingSimilar Papers 제목 키워드 기반
Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking
In video object tracking, there exist rich temporal contexts among successive frames, which have been largely overlooked in existing trackers. In this work, we bridge the individual video frames and explore the temporal …
DecoderObjectObject TrackingVideo Object Tracking+2Multi-Branch Siamese Networks with Online Selection for Object Tracking
In this paper, we propose a robust object tracking algorithm based on a branch selection mechanism to choose the most efficient object representations from multi-branch siamese networks. While most deep learning trackers…
ObjectObject TrackingSiamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis
Unmanned aerial vehicle (UAV)-based visual object tracking has enabled a wide range of applications and attracted increasing attention in the field of intelligent transportation systems because of its versatility and eff…
Object TrackingVisual Object TrackingF-Siamese Tracker: A Frustum-based Double Siamese Network for 3D Single Object Tracking
This paper presents F-Siamese Tracker, a novel approach for single object tracking prominently characterized by more robustly integrating 2D and 3D information to reduce redundant search space. A main challenge in 3D sin…
3D Single Object TrackingObjectObject TrackingFaster and Simpler Siamese Network for Single Object Tracking
Single object tracking (SOT) is currently one of the most important tasks in computer vision. With the development of the deep network and the release for a series of large scale datasets for single object tracking, siam…
Objectobject-detectionObject DetectionObject Tracking