paper-with-me

Papers

Unsupervised Online Video Object Segmentation with Motion Property Understanding

2018-10-09 · IEEE Transactions on Image Processing 2019 8 · Tao Zhuo, Zhiyong Cheng, Peng Zhang, Yongkang Wong, Mohan Kankanhalli

Unsupervised video object segmentation aims to automatically segment moving objects over an unconstrained video without any user annotation. So far, only few unsupervised online methods have been reported in literature and their performance is still far from satisfactory, because the complementary information from future frames cannot be processed under online setting. To solve this challenging problem, in this paper, we propose a novel Unsupervised Online Video Object Segmentation (UOVOS) framework by construing the motion property to mean moving in concurrence with a generic object for segmented regions. By incorporating salient motion detection and object proposal, a pixel-wise fusion strategy is developed to effectively remove detection noise such as dynamic background and stationary objects. Furthermore, by leveraging the obtained segmentation from immediately preceding frames, a forward propagation algorithm is employed to deal with unreliable motion detection and object proposals. Experimental results on several benchmark datasets demonstrate the efficacy of the proposed method. Compared to the state-of-the-art unsupervised online segmentation algorithms, the proposed method achieves an absolute gain of 6.2%. Moreover, our method achieves better performance than the best unsupervised offline algorithm on the DAVIS-2016 benchmark dataset. Our code is available on the project website: https://github.com/visiontao/uovos.

📄 PDF Abstract BibTeX arXiv:1810.03783

Code (1)

VisionTao/UOVOS 공식 구현

Tasks

Motion DetectionObjectSegmentationSemantic SegmentationUnsupervised Video Object SegmentationVideo Object SegmentationVideo Semantic Segmentation

Similar Papers 제목 키워드 기반

Unsupervised Video Object Segmentation with Distractor-Aware Online Adaptation

2018-12-19 · Ye Wang, Jongmoo Choi, Yueru Chen, Siyang Li 외

Unsupervised video object segmentation is a crucial application in video analysis without knowing any prior information about the objects. It becomes tremendously challenging when multiple objects occur and interact in a…

Instance SegmentationObjectSegmentationSemantic Segmentation+3

Unsupervised Object-Level Video Summarization with Online Motion Auto-Encoder

2018-01-02 · Yu-jia Zhang, Xiaodan Liang, Dingwen Zhang, Min Tan 외

Unsupervised video summarization plays an important role on digesting, browsing, and searching the ever-growing videos every day, and the underlying fine-grained semantic and motion information (i.e., objects of interest…

ObjectUnsupervised Video SummarizationVideo Summarization

Online Unsupervised Video Object Segmentation via Contrastive Motion Clustering

2023-06-21 · Lin Xi, Weihai Chen, Xingming Wu, Zhong Liu 외

Online unsupervised video object segmentation (UVOS) uses the previous frames as its input to automatically separate the primary object(s) from a streaming video without using any further manual annotation. A major chall…

ClusteringContrastive LearningObjectOptical Flow Estimation+5

Design Pseudo Ground Truth with Motion Cue for Unsupervised Video Object Segmentation

2018-12-13 · Ye Wang, Jongmoo Choi, Yueru Chen, Qin Huang 외

One major technique debt in video object segmentation is to label the object masks for training instances. As a result, we propose to prepare inexpensive, yet high quality pseudo ground truth corrected with motion cue fo…

Instance SegmentationObjectObject TrackingSegmentation+4

Object Detection, Tracking, and Motion Segmentation for Object-level Video Segmentation

2016-08-10 · Benjamin Drayer, Thomas Brox

We present an approach for object segmentation in videos that combines frame-level object detection with concepts from object tracking and motion segmentation. The approach extracts temporally consistent object tubes bas…

Motion SegmentationObjectobject-detectionObject Detection+5