Efficient Video Segmentation Using Parametric Graph Partitioning
Video segmentation is the task of grouping similar pixels in the spatio-temporal domain, and has become an important preprocessing step for subsequent video analysis. Most video segmentation and supervoxel methods output a hierarchy of segmentations, but while this provides useful multiscale information, it also adds difficulty in selecting the appropriate level for a task. In this work, we propose an efficient and robust video segmentation framework based on parametric graph partitioning (PGP), a fast, almost parameter free graph partitioning method that identifies and removes between-cluster edges to form node clusters. Apart from its computational efficiency, PGP performs clustering of the spatio-temporal volume without requiring a pre-specified cluster number or bandwidth parameters, thus making video segmentation more practical to use in applications. The PGP framework also allows processing sub-volumes, which further improves performance, contrary to other streaming video segmentation methods where sub-volume processing reduces performance. We evaluate the PGP method using the SegTrack v2 and Chen Xiph.org datasets, and show that it outperforms related state-of-the-art algorithms in 3D segmentation metrics and running time.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringComputational Efficiencygraph partitioningSegmentationVideo SegmentationVideo Semantic SegmentationSimilar Papers 제목 키워드 기반
Classifier Based Graph Construction for Video Segmentation
Video segmentation has become an important and active research area with a large diversity of proposed approaches. Graph-based methods, enabling topperformance on recent benchmarks, consist of three essential components:…
Diversitygraph constructiongraph partitioningSegmentation+3Improved Image Boundaries for Better Video Segmentation
Graph-based video segmentation methods rely on superpixels as starting point. While most previous work has focused on the construction of the graph edges and weights as well as solving the graph partitioning problem, thi…
graph partitioningSegmentationSuperpixelsVideo Segmentation+1Revisiting Surgical Instrument Segmentation Without Human Intervention: A Graph Partitioning View
Surgical instrument segmentation (SIS) on endoscopic images stands as a long-standing and essential task in the context of computer-assisted interventions for boosting minimally invasive surgery. Given the recent surge o…
graph partitioningDeep Nonparametric Estimation of Discrete Conditional Distributions via Smoothed Dyadic Partitioning
We present an approach to deep estimation of discrete conditional probability distributions. Such models have several applications, including generative modeling of audio, image, and video data. Our approach combines two…
Maximin affinity learning of image segmentation
Images can be segmented by first using a classifier to predict an affinity graph that reflects the degree to which image pixels must be grouped together and then partitioning the graph to yield a segmentation. Machine le…
BIG-bench Machine Learninggraph partitioningImage SegmentationSegmentation+1