DepthFlow: Exploiting Depth-Flow Structural Correlations for Unsupervised Video Object Segmentation
Unsupervised video object segmentation (VOS) aims to detect the most prominent object in a video. Recently, two-stream approaches that leverage both RGB images and optical flow have gained significant attention, but their performance is fundamentally constrained by the scarcity of training data. To address this, we propose DepthFlow, a novel data generation method that synthesizes optical flow from single images. Our approach is driven by the key insight that VOS models depend more on structural information embedded in flow maps than on their geometric accuracy, and that this structure is highly correlated with depth. We first estimate a depth map from a source image and then convert it into a synthetic flow field that preserves essential structural cues. This process enables the transformation of large-scale image-mask pairs into image-flow-mask training pairs, dramatically expanding the data available for network training. By training a simple encoder-decoder architecture with our synthesized data, we achieve new state-of-the-art performance on all public VOS benchmarks, demonstrating a scalable and effective solution to the data scarcity problem.
Code (0)
등록된 구현이 없습니다.
Tasks
Unsupervised Video Object SegmentationSimilar Papers 제목 키워드 기반
Joint Unsupervised Learning of Optical Flow and Depth by Watching Stereo Videos
Learning depth and optical flow via deep neural networks by watching videos has made significant progress recently. In this paper, we jointly solve the two tasks by exploiting the underlying geometric rules within stereo…
Motion EstimationOptical Flow EstimationExploiting Correspondences with All-pairs Correlations for Multi-view Depth Estimation
Multi-view depth estimation plays a critical role in reconstructing and understanding the 3D world. Recent learning-based methods have made significant progress in it. However, multi-view depth estimation is fundamentall…
AllDepth EstimationDepth PredictionOptical Flow EstimationStructure Flow-Guided Network for Real Depth Super-Resolution
Real depth super-resolution (DSR), unlike synthetic settings, is a challenging task due to the structural distortion and the edge noise caused by the natural degradation in real-world low-resolution (LR) depth maps. Thes…
Depth EstimationDepth PredictionSuper-ResolutionFG-Depth: Flow-Guided Unsupervised Monocular Depth Estimation
The great potential of unsupervised monocular depth estimation has been demonstrated by many works due to low annotation cost and impressive accuracy comparable to supervised methods. To further improve the performance, …
Depth EstimationImage ReconstructionMonocular Depth EstimationSemantic Segmentation+1Depth Map Completion by Jointly Exploiting Blurry Color Images and Sparse Depth Maps
We aim at predicting a complete and high-resolution depth map from incomplete, sparse and noisy depth measurements. Existing methods handle this problem either by exploiting various regularizations on the depth maps dire…