High-Speed Tracking with Kernelized Correlation Filters
The core component of most modern trackers is a discriminative classifier, tasked with distinguishing between the target and the surrounding environment. To cope with natural image changes, this classifier is typically trained with translated and scaled sample patches. Such sets of samples are riddled with redundancies -- any overlapping pixels are constrained to be the same. Based on this simple observation, we propose an analytic model for datasets of thousands of translated patches. By showing that the resulting data matrix is circulant, we can diagonalize it with the Discrete Fourier Transform, reducing both storage and computation by several orders of magnitude. Interestingly, for linear regression our formulation is equivalent to a correlation filter, used by some of the fastest competitive trackers. For kernel regression, however, we derive a new Kernelized Correlation Filter (KCF), that unlike other kernel algorithms has the exact same complexity as its linear counterpart. Building on it, we also propose a fast multi-channel extension of linear correlation filters, via a linear kernel, which we call Dual Correlation Filter (DCF). Both KCF and DCF outperform top-ranking trackers such as Struck or TLD on a 50 videos benchmark, despite running at hundreds of frames-per-second, and being implemented in a few lines of code (Algorithm 1). To encourage further developments, our tracking framework was made open-source.
Code (9)
Tasks
regressionVideo Object TrackingVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
EnKCF: Ensemble of Kernelized Correlation Filters for High-Speed Object Tracking
Computer vision technologies are very attractive for practical applications running on embedded systems. For such an application, it is desirable for the deployed algorithms to run in high-speed and require no offline tr…
Object TrackingVocal Bursts Intensity PredictionTracking in Aerial Hyperspectral Videos using Deep Kernelized Correlation Filters
Hyperspectral imaging holds enormous potential to improve the state-of-the-art in aerial vehicle tracking with low spatial and temporal resolutions. Recently, adaptive multi-modal hyperspectral sensors have attracted gro…
General ClassificationImage GenerationObject Trackingvehicle detectionParticle filter re-detection for visual tracking via correlation filters
Most of the correlation filter based tracking algorithms can achieve good performance and maintain fast computational speed. However, in some complicated tracking scenes, there is a fatal defect that causes the object to…
ObjectObject LocalizationVisual TrackingMultiple Object Tracking with Kernelized Correlation Filters in Urban Mixed Traffic
Recently, the Kernelized Correlation Filters tracker (KCF) achieved competitive performance and robustness in visual object tracking. On the other hand, visual trackers are not typically used in multiple object tracking.…
Multiple Object TrackingObjectObject TrackingVisual Object TrackingHigh Speed Tracking With A Fourier Domain Kernelized Correlation Filter
It is challenging to design a high speed tracking approach using l1-norm due to its non-differentiability. In this paper, a new kernelized correlation filter is introduced by leveraging the sparsity attribute of l1-norm …
AttributeVocal Bursts Intensity Prediction