paper-with-me

홈 › Papers

Learning to Adversarially Blur Visual Object Tracking

2021-07-26 · ICCV 2021 10 · Qing Guo, Ziyi Cheng, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Yang Liu, Jianjun Zhao

Motion blur caused by the moving of the object or camera during the exposure can be a key challenge for visual object tracking, affecting tracking accuracy significantly. In this work, we explore the robustness of visual object trackers against motion blur from a new angle, i.e., adversarial blur attack (ABA). Our main objective is to online transfer input frames to their natural motion-blurred counterparts while misleading the state-of-the-art trackers during the tracking process. To this end, we first design the motion blur synthesizing method for visual tracking based on the generation principle of motion blur, considering the motion information and the light accumulation process. With this synthetic method, we propose optimization-based ABA (OP-ABA) by iteratively optimizing an adversarial objective function against the tracking w.r.t. the motion and light accumulation parameters. The OP-ABA is able to produce natural adversarial examples but the iteration can cause heavy time cost, making it unsuitable for attacking real-time trackers. To alleviate this issue, we further propose one-step ABA (OS-ABA) where we design and train a joint adversarial motion and accumulation predictive network (JAMANet) with the guidance of OP-ABA, which is able to efficiently estimate the adversarial motion and accumulation parameters in a one-step way. The experiments on four popular datasets (e.g., OTB100, VOT2018, UAV123, and LaSOT) demonstrate that our methods are able to cause significant accuracy drops on four state-of-the-art trackers with high transferability. Please find the source code at \url{https://github.com/tsingqguo/ABA}.

📄 PDF Abstract BibTeX arXiv:2107.12085

Code (1)

tsingqguo/ABA 공식 구현 jax

Tasks

ObjectObject TrackingVisual Object TrackingVisual Tracking

Similar Papers 제목 키워드 기반

Effects of Blur and Deblurring to Visual Object Tracking

2019-08-21 · Qing Guo, Wei Feng, Zhihao Chen, Ruijun Gao 외

Intuitively, motion blur may hurt the performance of visual object tracking. However, we lack quantitative evaluation of tracker robustness to different levels of motion blur. Meanwhile, while image deblurring methods ca…

DeblurringImage DeblurringObject TrackingVisual Object Tracking

Event-based Visual Tracking in Dynamic Environments

2022-12-15 · Irene Perez-Salesa, Rodrigo Aldana-Lopez, Carlos Sagues

Visual object tracking under challenging conditions of motion and light can be hindered by the capabilities of conventional cameras, prone to producing images with motion blur. Event cameras are novel sensors suited to r…

Objectobject-detectionObject DetectionObject Tracking+2

NT-VOT211: A Large-Scale Benchmark for Night-time Visual Object Tracking

2024-10-27 · Yu Liu, Arif Mahmood, Muhammad Haris Khan

Many current visual object tracking benchmarks such as OTB100, NfS, UAV123, LaSOT, and GOT-10K, predominantly contain day-time scenarios while the challenges posed by the night-time has been less investigated. It is prim…

Object TrackingVideo Object TrackingVisual Object Tracking

SINT++: Robust Visual Tracking via Adversarial Positive Instance Generation

2018-06-01 · CVPR 2018 6 · Xiao Wang, Chenglong Li, Bin Luo, Jin Tang

Existing visual trackers are easily disturbed by occlusion,blurandlargedeformation. Inthechallengesofocclusion, motion blur and large object deformation, the performance of existing visual trackers may be limited due to …

Deep Reinforcement LearningObjectReinforcement LearningVisual Tracking

Visual Coin-Tracking: Tracking of Planar Double-Sided Objects

2019-08-07 · Jonáš Šerých, Jiří Matas

We introduce a new video analysis problem -- tracking of rigid planar objects in sequences where both their sides are visible. Such coin-like objects often rotate fast with respect to an arbitrary axis producing unique c…

SegmentationSemantic Segmentation