Long and Short Memory Balancing in Visual Co-Tracking using Q-Learning
Employing one or more additional classifiers to break the self-learning loop in tracing-by-detection has gained considerable attention. Most of such trackers merely utilize the redundancy to address the accumulating label error in the tracking loop, and suffer from high computational complexity as well as tracking challenges that may interrupt all classifiers (e.g. temporal occlusions). We propose the active co-tracking framework, in which the main classifier of the tracker labels samples of the video sequence, and only consults auxiliary classifier when it is uncertain. Based on the source of the uncertainty and the differences of two classifiers (e.g. accuracy, speed, update frequency, etc.), different policies should be taken to exchange the information between two classifiers. Here, we introduce a reinforcement learning approach to find the appropriate policy by considering the state of the tracker in a specific sequence. The proposed method yields promising results in comparison to the best tracking-by-detection approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Q-LearningReinforcement LearningSelf-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Rethinking Memory Design in SAM-Based Visual Object Tracking
\noindent Memory has become the central mechanism enabling robust visual object tracking in modern segmentation-based frameworks. Recent methods built upon Segment Anything Model 2 (SAM2) have demonstrated strong perform…
Visual Object TrackingResearch on Data Fusion Algorithm Based on Deep Learning in Target Tracking
Aiming at the limitation that deep long and short-term memory network(DLSTM) algorithm cannot perform parallel computing and cannot obtain global information, in this paper, feature extraction and feature processing are …
MUlti-Store Tracker (MUSTer): A Cognitive Psychology Inspired Approach to Object Tracking
Variations in the appearance of a tracked object, such as changes in geometry/photometry, camera viewpoint, illumination, or partial occlusion, pose a major challenge to object tracking. Here, we adopt cognitive psycholo…
ObjectObject TrackingRobust offset-free constrained Model Predictive Control with Long Short-Term Memory Networks -- Extended version
This paper develops a control scheme, based on the use of Long Short-Term Memory neural network models and Nonlinear Model Predictive Control, which guarantees recursive feasibility with slow time variant set-points and …
Model Predictive ControlAdaptive Correlation Filters with Long-Term and Short-Term Memory for Object Tracking
Object tracking is challenging as target objects often undergo drastic appearance changes over time. Recently, adaptive correlation filters have been successfully applied to object tracking. However, tracking algorithms …
Object TrackingPosition