Unsupervised learning-based long-term superpixel tracking
Finding correspondences between structural entities decomposing images is of high interest for computer vision applications. In particular, we analyze how to accurately track superpixels - visual primitives generated by aggregating adjacent pixels sharing similar characteristics - over extended time periods relying on unsupervised learning and temporal integration. A two-step video processing pipeline dedicated to long-term superpixel tracking is proposed. First, unsupervised learning-based superpixel matching provides correspondences between consecutive and distant frames using new context-rich features extended from greyscale to multi-channel and forward-backward consistency contraints. Resulting elementary matches are then combined along multi-step paths running through the whole sequence with various inter-frame distances. This produces a large set of candidate long-term superpixel pairings upon which majority voting is performed. Video object tracking experiments demonstrate the accuracy of our elementary estimator against state-of-the-art methods and proves the ability of multi-step integration to provide accurate long-term superpixel matches compared to usual direct and sequential integration.
Code (0)
등록된 구현이 없습니다.
Tasks
Object TrackingSuperpixelsVideo Object TrackingSimilar Papers 제목 키워드 기반
Super-Trajectories: A Compact Yet Rich Video Representation
We propose a new video representation in terms of an over-segmentation of dense trajectories covering the whole video. Trajectories are often used to encode long-temporal information in several computer vision applicatio…
PositionSuperpixelsSuperpixel-Based Tracking-By-Segmentation Using Markov Chains
We propose a simple but effective tracking-by-segmentation algorithm using Absorbing Markov Chain (AMC) on superpixel segmentation, where target state is estimated by a combination of bottom-up and top-down approaches, …
graph constructionSegmentationSuperpixelsLearning the Superpixel in a Non-iterative and Lifelong Manner
Superpixel is generated by automatically clustering pixels in an image into hundreds of compact partitions, which is widely used to perceive the object contours for its excellent contour adherence. Although some works us…
ClusteringLifelong learningUnsupervised Video Segmentation via Spatio-Temporally Nonlocal Appearance Learning
Video object segmentation is challenging due to the factors like rapidly fast motion, cluttered backgrounds, arbitrary object appearance variation and shape deformation. Most existing methods only explore appearance info…
SegmentationSemantic SegmentationSuperpixelsVideo Object Segmentation+2Generating superpixels using deep image representations
Superpixel algorithms are a common pre-processing step for computer vision algorithms such as segmentation, object tracking and localization. Many superpixel methods only rely on colors features for segmentation, limitin…
ClusteringGeneral ClassificationObjectObject Tracking+3