Classifier Based Graph Construction for Video Segmentation
Video segmentation has become an important and active research area with a large diversity of proposed approaches. Graph-based methods, enabling topperformance on recent benchmarks, consist of three essential components: 1. powerful features account for object appearance and motion similarities; 2. spatio-temporal neighborhoods of pixels or superpixels (the graph edges) are modeled using a combination of those features; 3. video segmentation is formulated as a graph partitioning problem. While a wide variety of features have been explored and various graph partition algorithms have been proposed, there is surprisingly little research on how to construct a graph to obtain the best video segmentation performance. This is the focus of our paper. We propose to combine features by means of a classifier, use calibrated classifier outputs as edge weights and define the graph topology by edge selection. By learning the graph (without changes to the graph partitioning method), we improve the results of the best performing video segmentation algorithm by 6% on the challenging VSB100 benchmark, while reducing its runtime by 55%, as the learnt graph is much sparser.
Code (0)
등록된 구현이 없습니다.
Tasks
Diversitygraph constructiongraph partitioningSegmentationSuperpixelsVideo SegmentationVideo Semantic SegmentationSimilar Papers 제목 키워드 기반
Improved Image Boundaries for Better Video Segmentation
Graph-based video segmentation methods rely on superpixels as starting point. While most previous work has focused on the construction of the graph edges and weights as well as solving the graph partitioning problem, thi…
graph partitioningSegmentationSuperpixelsVideo Segmentation+13D Reconstruction of Coronary Vessel Trees from Biplanar X-Ray Images Using a Geometric Approach
X-ray angiography is widely used in cardiac interventions to visualize coronary vessels, assess integrity, detect stenoses and guide treatment. We propose a framework for reconstructing 3D vessel trees from biplanar X-ra…
Semantic SegmentationVideo SegmentationImage Segmentation3D ReconstructionPanopticRecon: Leverage Open-vocabulary Instance Segmentation for Zero-shot Panoptic Reconstruction
Panoptic reconstruction is a challenging task in 3D scene understanding. However, most existing methods heavily rely on pre-trained semantic segmentation models and known 3D object bounding boxes for 3D panoptic segmenta…
3D Panoptic SegmentationInstance SegmentationPanoptic SegmentationScene Understanding+3Ensemble Video Object Cut in Highly Dynamic Scenes
We consider video object cut as an ensemble of framelevel background-foreground object classifiers which fuses information across frames and refine their segmentation results in a collaborative and iterative manner. Our …
Change DetectionObjectSegmentationSemantic SegmentationComparative Analysis of Image, Video, and Audio Classifiers for Automated News Video Segmentation
News videos require efficient content organisation and retrieval systems, but their unstructured nature poses significant challenges for automated processing. This paper presents a comprehensive comparative analysis of i…
Binary ClassificationVideo SegmentationVideo Semantic Segmentation