paper-with-me

홈 › Papers

Robust Object Modeling for Visual Tracking

2023-08-09 · ICCV 2023 1 · Yidong Cai, Jie Liu, Jie Tang, Gangshan Wu

Object modeling has become a core part of recent tracking frameworks. Current popular tackers use Transformer attention to extract the template feature separately or interactively with the search region. However, separate template learning lacks communication between the template and search regions, which brings difficulty in extracting discriminative target-oriented features. On the other hand, interactive template learning produces hybrid template features, which may introduce potential distractors to the template via the cluttered search regions. To enjoy the merits of both methods, we propose a robust object modeling framework for visual tracking (ROMTrack), which simultaneously models the inherent template and the hybrid template features. As a result, harmful distractors can be suppressed by combining the inherent features of target objects with search regions' guidance. Target-related features can also be extracted using the hybrid template, thus resulting in a more robust object modeling framework. To further enhance robustness, we present novel variation tokens to depict the ever-changing appearance of target objects. Variation tokens are adaptable to object deformation and appearance variations, which can boost overall performance with negligible computation. Experiments show that our ROMTrack sets a new state-of-the-art on multiple benchmarks.

📄 PDF Abstract BibTeX arXiv:2308.05140

Code (1)

dawnyc/romtrack 공식 구현 pytorch

Tasks

ObjectVisual Tracking

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

ACTrack: Adding Spatio-Temporal Condition for Visual Object Tracking

2024-02-27 · Yushan Han, Kaer Huang

Efficiently modeling spatio-temporal relations of objects is a key challenge in visual object tracking (VOT). Existing methods track by appearance-based similarity or long-term relation modeling, resulting in rich tempor…

ObjectObject TrackingVisual Object Tracking

Foreground-Background Distribution Modeling Transformer for Visual Object Tracking

2023-01-01 · ICCV 2023 1 · Dawei Yang, Jianfeng He, Yinchao Ma, Qianjin Yu 외

Visual object tracking is a fundamental research topic with a broad range of applications. Benefiting from the rapid development of Transformer, pure Transformer trackers have achieved great progress. However, the fe…

ObjectObject TrackingState EstimationVisual Object Tracking

Reliable Object Tracking by Multimodal Hybrid Feature Extraction and Transformer-Based Fusion

2024-05-28 · Hongze Sun, Rui Liu, Wuque Cai, Jun Wang 외

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To ad…

ObjectObject TrackingVisual Object Tracking

Exploring Object Status Recognition for Recipe Progress Tracking in Non-Visual Cooking

2025-07-04 · Franklin Mingzhe Li, Kaitlyn Ng, Bin Zhu, Patrick Carrington arxiv

Cooking plays a vital role in everyday independence and well-being, yet remains challenging for people with vision impairments due to limited support for tracking progress and receiving contextual feedback. Object status…

SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking

2026-02-02 · Yinchao Ma, Dengqing Yang, Zhangyu He, Wenfei Yang 외 arxiv

Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enh…

Visual Tracking