Visual Object Tracking by Segmentation with Graph Convolutional Network
Segmentation-based tracking has been actively studied in computer vision and multimedia. Superpixel based object segmentation and tracking methods are usually developed for this task. However, they independently perform feature representation and learning of superpixels which may lead to sub-optimal results. In this paper, we propose to utilize graph convolutional network (GCN) model for superpixel based object tracking. The proposed model provides a general end-to-end framework which integrates i) label linear prediction, and ii) structure-aware feature information of each superpixel together to obtain object segmentation and further improves the performance of tracking. The main benefits of the proposed GCN method have two main aspects. First, it provides an effective end-to-end way to exploit both spatial and temporal consistency constraint for target object segmentation. Second, it utilizes a mixed graph convolution module to learn a context-aware and discriminative feature for superpixel representation and labeling. An effective algorithm has been developed to optimize the proposed model. Extensive experiments on five datasets demonstrate that our method obtains better performance against existing alternative methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject TrackingSegmentationSemantic SegmentationSuperpixelsVisual Object TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SiamMask: A Framework for Fast Online Object Tracking and Segmentation
In this paper we introduce SiamMask, a framework to perform both visual object tracking and video object segmentation, in real-time, with the same simple method. We improve the offline training procedure of popular fully…
Multiple Object TrackingObjectObject TrackingSegmentation+4Eye Tracking Assisted Extraction of Attentionally Important Objects From Videos
Visual attention is a crucial indicator of the relative importance of objects in visual scenes to human viewers. In this paper, we propose an algorithm to extract objects which attract visual attention from videos. As hu…
ClusteringObjectSegmentationVideo Segmentation+1Visual Coin-Tracking: Tracking of Planar Double-Sided Objects
We introduce a new video analysis problem -- tracking of rigid planar objects in sequences where both their sides are visible. Such coin-like objects often rotate fast with respect to an arbitrary axis producing unique c…
SegmentationSemantic SegmentationFast Online Object Tracking and Segmentation: A Unifying Approach
In this paper we illustrate how to perform both visual object tracking and semi-supervised video object segmentation, in real-time, with a single simple approach. Our method, dubbed SiamMask, improves the offline trainin…
ObjectObject TrackingReal-Time Visual TrackingSegmentation+6A Discriminative Single-Shot Segmentation Network for Visual Object Tracking
Template-based discriminative trackers are currently the dominant tracking paradigm due to their robustness, but are restricted to bounding box tracking and a limited range of transformation models, which reduces their l…
ObjectObject TrackingSegmentationSemantic Segmentation+3