Fast Video Object Segmentation by Reference-Guided Mask Propagation
We present an efficient method for the semi-supervised video object segmentation. Our method achieves accuracy competitive with state-of-the-art methods while running in a fraction of time compared to others. To this end, we propose a deep Siamese encoder-decoder network that is designed to take advantage of mask propagation and object detection while avoiding the weaknesses of both approaches. Our network, learned through a two-stage training process that exploits both synthetic and real data, works robustly without any online learning or post-processing. We validate our method on four benchmark sets that cover single and multiple object segmentation. On all the benchmark sets, our method shows comparable accuracy while having the order of magnitude faster runtime. We also provide extensive ablation and add-on studies to analyze and evaluate our framework.
Code (2)
Tasks
DecoderObjectobject-detectionObject DetectionSegmentationSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object SegmentationVideo Semantic SegmentationVisual Object TrackingSimilar Papers 제목 키워드 기반
Spectrum-guided Multi-granularity Referring Video Object Segmentation
Current referring video object segmentation (R-VOS) techniques extract conditional kernels from encoded (low-resolution) vision-language features to segment the decoded high-resolution features. We discovered that this c…
ObjectReferring Expression SegmentationReferring Video Object SegmentationSegmentation+3Guided Interactive Video Object Segmentation Using Reliability-Based Attention Maps
We propose a novel guided interactive segmentation (GIS) algorithm for video objects to improve the segmentation accuracy and reduce the interaction time. First, we design the reliability-based attention module to analyz…
Interactive SegmentationInteractive Video Object SegmentationSegmentationSemantic Segmentation+2Motion-Guided Cascaded Refinement Network for Video Object Segmentation
Deep CNNs have achieved superior performance in many tasks of computer vision and image understanding. However, it is still difficult to effectively apply deep CNNs to video object segmentation(VOS) since treating video …
ObjectOptical Flow EstimationSegmentationSemantic Segmentation+2GSVNet: Guided Spatially-Varying Convolution for Fast Semantic Segmentation on Video
This paper addresses fast semantic segmentation on video.Video segmentation often calls for real-time, or even fasterthan real-time, processing. One common recipe for conserving computation arising from feature extractio…
Image SegmentationSegmentationSemantic SegmentationVideo Segmentation+1InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Models
Boosted by Multi-modal Large Language Models (MLLMs), text-guided universal segmentation models for the image and video domains have made rapid progress recently. However, these methods are often developed separately for…
Reasoning SegmentationSegmentationUniversal SegmentationVideo Segmentation+2