Visual object tracking performance measures revisited
The problem of visual tracking evaluation is sporting a large variety of performance measures, and largely suffers from lack of consensus about which measures should be used in experiments. This makes the cross-paper tracker comparison difficult. Furthermore, as some measures may be less effective than others, the tracking results may be skewed or biased towards particular tracking aspects. In this paper we revisit the popular performance measures and tracker performance visualizations and analyze them theoretically and experimentally. We show that several measures are equivalent from the point of information they provide for tracker comparison and, crucially, that some are more brittle than the others. Based on our analysis we narrow down the set of potential measures to only two complementary ones, describing accuracy and robustness, thus pushing towards homogenization of the tracker evaluation methodology. These two measures can be intuitively interpreted and visualized and have been employed by the recent Visual Object Tracking (VOT) challenges as the foundation for the evaluation methodology.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject TrackingVisual Object TrackingVisual TrackingSimilar Papers 제목 키워드 기반
Performance Evaluation Methodology for Long-Term Visual Object Tracking
A long-term visual object tracking performance evaluation methodology and a benchmark are proposed. Performance measures are designed by following a long-term tracking definition to maximize the analysis probing strength…
BenchmarkingObjectObject TrackingVisual Object TrackingCDTB: A Color and Depth Visual Object Tracking Dataset and Benchmark
A long-term visual object tracking performance evaluation methodology and a benchmark are proposed. Performance measures are designed by following a long-term tracking definition to maximize the analysis probing strength…
BenchmarkingObject TrackingVisual Object TrackingSaliency Revisited: Analysis of Mouse Movements versus Fixations
This paper revisits visual saliency prediction by evaluating the recent advancements in this field such as crowd-sourced mouse tracking-based databases and contextual annotations. We pursue a critical and quantitative ap…
Model SelectionSaliency PredictionNew Performance Measures for Object Tracking under Complex Environments
Various performance measures based on the ground truth and without ground truth exist to evaluate the quality of a developed tracking algorithm. The existing popular measures - average center location error (ACLE) and av…
Object TrackingVisual Object Tracking in First Person Vision
The understanding of human-object interactions is fundamental in First Person Vision (FPV). Visual tracking algorithms which follow the objects manipulated by the camera wearer can provide useful information to effective…
Human-Object Interaction DetectionObjectObject TrackingVisual Object Tracking+1