Deep Reinforcement Learning with Iterative Shift for Visual Tracking
Visual tracking is confronted by the dilemma to locate a target both}accurately and efficiently, and make decisions online whether and how to adapt the appearance model or even restart tracking. In this paper, we propose a deep reinforcement learning with iterative shift (DRL-IS) method for single object tracking, where an actor-critic network is introduced to predict the iterative shifts of object bounding boxes, and evaluate the shifts to take actions on whether to update object models or re-initialize tracking. Since locating an object is achieved by an iterative shift process, rather than online classification on many sampled locations, the proposed method is robust to cope with large deformations and abrupt motion, and computationally efficient since finding a target takes up to 10 shifts. In offline training, the critic network guides to learn how to make decisions jointly on motion estimation and tracking status in an end-to-end manner. Experimental results on the OTB benchmarks with large deformation improve the tracking precision by 1.7% and runs about 5 times faster than the competing state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningMotion EstimationObjectObject Trackingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Visual TrackingSimilar Papers 제목 키워드 기반
GridShift: A Faster Mode-seeking Algorithm for Image Segmentation and Object Tracking
In machine learning and computer vision, mean shift (MS) qualifies as one of the most popular mode-seeking algorithms used for clustering and image segmentation. It iteratively moves each data point to the weighted mean …
Image SegmentationObject TrackingSegmentationSemantic SegmentationGlance-or-Gaze: Incentivizing LMMs to Adaptively Focus Search via Reinforcement Learning
Large Multimodal Models (LMMs) have achieved remarkable success in visual understanding, yet they struggle with knowledge-intensive queries involving long-tail entities or evolving information due to static parametric kn…
Reinforcement LearningImage RetrievalCD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking
Referring multi-object tracking (RMOT) extends tracking from category-driven perception to language-guided understanding by grounding object trajectories in natural-language expressions. Despite recent progress, existing…
Multi-Object TrackingObject DetectionSemi-Automatic Annotation For Visual Object Tracking
We propose a semi-automatic bounding box annotation method for visual object tracking by utilizing temporal information with a tracking-by-detection approach. For detection, we use an off-the-shelf object detector which …
Incremental LearningObjectobject-detectionObject Detection+2Shift If You Can: Counting and Visualising Correction Operations for Beat Tracking Evaluation
In this late-breaking abstract we propose a modified approach for beat tracking evaluation which poses the problem in terms of the effort required to transform a sequence of beat detections such that they maximise the we…
Beat Tracking