Coherent Parametric Contours for Interactive Video Object Segmentation
Interactive video segmentation systems aim at producing sub-pixel-level object boundaries for visual effect applications. Recent approaches mainly focus on using sparse user input (i.e. scribbles) for efficient segmentation; however, the quality of the final object boundaries is not satisfactory for the following reasons: (1) the boundary on each frame is often not accurate; (2) boundaries across adjacent frames wiggle around inconsistently, causing temporal flickering; and (3) there is a lack of direct user control for fine tuning. We propose Coherent Parametric Contours, a novel video segmentation propagation framework that addresses all the above issues. Our approach directly models the object boundary using a set of parametric curves, providing direct user controls for manual adjustment. A spatio-temporal optimization algorithm is employed to produce object boundaries that are spatially accurate and temporally stable. We show that existing evaluation datasets are limited and demonstrate a new set to cover the common cases in professional rotoscoping. A new metric for evaluating temporal consistency is proposed. Results show that our approach generates higher quality, more coherent segmentation results than previous methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Interactive Video Object SegmentationObjectSegmentationSemantic SegmentationVideo Object SegmentationVideo SegmentationVideo Semantic SegmentationSimilar Papers 제목 키워드 기반
Interactive Visual Hull Refinement for Specular and Transparent Object Surface Reconstruction
In this paper we present a method of using standard multi-view images for 3D surface reconstruction of non-Lambertian objects. We extend the original visual hull concept to incorporate 3D cues presented by internal occlu…
Contour DetectionSurface ReconstructionTransparent objectsvalidA Weighted Superposition of Functional Contours Model for Modelling Contextual Prominence of Elementary Prosodic Contours
The way speech prosody encodes linguistic, paralinguistic and non-linguistic information via multiparametric representations of the speech signals is still an open issue. The Superposition of Functional Contours (SFC) mo…
Contour-based Interactive Segmentation
Recent advances in interactive segmentation (IS) allow speeding up and simplifying image editing and labeling greatly. The majority of modern IS approaches accept user input in the form of clicks. However, using clicks m…
FormInteractive SegmentationSegmentationOCT segmentation: Integrating open parametric contour model of the retinal layers and shape constraint to the Mumford-Shah functional
In this paper, we propose a novel retinal layer boundary model for segmentation of optical coherence tomography (OCT) images. The retinal layer boundary model consists of 9 open parametric contours representing the 9 ret…
ScribbleBox: Interactive Annotation Framework for Video Object Segmentation
Manually labeling video datasets for segmentation tasks is extremely time consuming. In this paper, we introduce ScribbleBox, a novel interactive framework for annotating object instances with masks in videos. In particu…
ObjectSegmentationSemantic SegmentationVideo Object Segmentation+1