Robust Object Modeling for Visual Tracking
Object modeling has become a core part of recent tracking frameworks. Current popular tackers use Transformer attention to extract the template feature separately or interactively with the search region. However, separate template learning lacks communication between the template and search regions, which brings difficulty in extracting discriminative target-oriented features. On the other hand, interactive template learning produces hybrid template features, which may introduce potential distractors to the template via the cluttered search regions. To enjoy the merits of both methods, we propose a robust object modeling framework for visual tracking (ROMTrack), which simultaneously models the inherent template and the hybrid template features. As a result, harmful distractors can be suppressed by combining the inherent features of target objects with search regions' guidance. Target-related features can also be extracted using the hybrid template, thus resulting in a more robust object modeling framework. To further enhance robustness, we present novel variation tokens to depict the ever-changing appearance of target objects. Variation tokens are adaptable to object deformation and appearance variations, which can boost overall performance with negligible computation. Experiments show that our ROMTrack sets a new state-of-the-art on multiple benchmarks.
Code (1)
Tasks
ObjectVisual TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ACTrack: Adding Spatio-Temporal Condition for Visual Object Tracking
Efficiently modeling spatio-temporal relations of objects is a key challenge in visual object tracking (VOT). Existing methods track by appearance-based similarity or long-term relation modeling, resulting in rich tempor…
ObjectObject TrackingVisual Object TrackingForeground-Background Distribution Modeling Transformer for Visual Object Tracking
Visual object tracking is a fundamental research topic with a broad range of applications. Benefiting from the rapid development of Transformer, pure Transformer trackers have achieved great progress. However, the fe…
ObjectObject TrackingState EstimationVisual Object TrackingReliable Object Tracking by Multimodal Hybrid Feature Extraction and Transformer-Based Fusion
Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To ad…
ObjectObject TrackingVisual Object TrackingExploring Object Status Recognition for Recipe Progress Tracking in Non-Visual Cooking
Cooking plays a vital role in everyday independence and well-being, yet remains challenging for people with vision impairments due to limited support for tracking progress and receiving contextual feedback. Object status…
SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking
Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enh…
Visual Tracking