Unsupervised Video Object Segmentation using Motion Saliency-Guided Spatio-Temporal Propagation
Unsupervised video segmentation plays an important role in a wide variety of applications from object identification to compression. However, to date, fast motion, motion blur and occlusions pose significant challenges. To address these challenges for unsupervised video segmentation, we develop a novel saliency estimation technique as well as a novel neighborhood graph, based on optical flow and edge cues. Our approach leads to significantly better initial foreground-background estimates and their robust as well as accurate diffusion across time. We evaluate our proposed algorithm on the challenging DAVIS, SegTrack v2 and FBMS-59 datasets. Despite the usage of only a standard edge detector trained on 200 images, our method achieves state-of-the-art results outperforming deep learning based methods in the unsupervised setting. We even demonstrate competitive results comparable to deep learning based methods in the semi-supervised setting on the DAVIS dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningOptical Flow EstimationSaliency PredictionSegmentationSemantic SegmentationUnsupervised Video Object SegmentationVideo Object SegmentationVideo Salient Object DetectionVideo SegmentationVideo Semantic SegmentationSimilar Papers 제목 키워드 기반
Saliency-Motion Guided Trunk-Collateral Network for Unsupervised Video Object Segmentation
Recent mainstream unsupervised video object segmentation (UVOS) motion-appearance approaches use either the bi-encoder structure to separately encode motion and appearance features, or the uni-encoder structure for joint…
Optical Flow EstimationSalient Object DetectionSemantic SegmentationUnsupervised Video Object Segmentation+3Saliency-Aware Geodesic Video Object Segmentation
We introduce an unsupervised, geodesic distance based, salient video object segmentation method. Unlike traditional methods, our method incorporates saliency as prior for object via the computation of robust geodesic mea…
ObjectSegmentationSemantic SegmentationVideo Object Segmentation+2Learning To Segment Dominant Object Motion From Watching Videos
Existing deep learning based unsupervised video object segmentation methods still rely on ground-truth segmentation masks to train. Unsupervised in this context only means that no annotated frames are used during inferen…
ObjectOptical Flow EstimationSegmentationSemantic Segmentation+3Key Instance Selection for Unsupervised Video Object Segmentation
This paper proposes key instance selection based on video saliency covering objectness and dynamics for unsupervised video object segmentation (UVOS). Our method takes frames sequentially and extracts object proposals wi…
ObjectSegmentationSemantic SegmentationUnsupervised Video Object Segmentation+2Tsanet: Temporal and Scale Alignment for Unsupervised Video Object Segmentation
Unsupervised Video Object Segmentation (UVOS) refers to the challenging task of segmenting the prominent object in videos without manual guidance. In recent works, two approaches for UVOS have been discussed that can be …
DecoderObjectOptical Flow EstimationSemantic Segmentation+3