Improving Unsupervised Video Object Segmentation via Fake Flow Generation
Unsupervised video object segmentation (VOS), also known as video salient object detection, aims to detect the most prominent object in a video at the pixel level. Recently, two-stream approaches that leverage both RGB images and optical flow maps have gained significant attention. However, the limited amount of training data remains a substantial challenge. In this study, we propose a novel data generation method that simulates fake optical flows from single images, thereby creating large-scale training data for stable network learning. Inspired by the observation that optical flow maps are highly dependent on depth maps, we generate fake optical flows by refining and augmenting the estimated depth maps of each image. By incorporating our simulated image-flow pairs, we achieve new state-of-the-art performance on all public benchmark datasets without relying on complex modules. We believe that our data generation method represents a potential breakthrough for future VOS research.
Code (0)
등록된 구현이 없습니다.
Tasks
Objectobject-detectionObject DetectionOptical Flow EstimationSalient Object DetectionSemantic SegmentationUnsupervised Video Object SegmentationVideo Object SegmentationVideo Salient Object DetectionVideo Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Instance Embedding Transfer to Unsupervised Video Object Segmentation
We propose a method for unsupervised video object segmentation by transferring the knowledge encapsulated in image-based instance embedding networks. The instance embedding network produces an embedding vector for each p…
ObjectOptical Flow EstimationSegmentationSemantic Segmentation+3Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion
Motion, measured via optical flow, provides a powerful cue to discover and learn objects in images and videos. However, compared to using appearance, it has some blind spots, such as the fact that objects become invisibl…
Image SegmentationOptical Flow EstimationSegmentationSemantic Segmentation+4FODVid: Flow-guided Object Discovery in Videos
Segmentation of objects in a video is challenging due to the nuances such as motion blurring, parallax, occlusions, changes in illumination, etc. Instead of addressing these nuances separately, we focus on building a gen…
ObjectObject DiscoveryObject Discovery In VideosSegmentation+3Flow-guided Semi-supervised Video Object Segmentation
We propose an optical flow-guided approach for semi-supervised video object segmentation. Optical flow is usually exploited as additional guidance information in unsupervised video object segmentation. However, its relev…
DecoderObjectOptical Flow EstimationSegmentation+5SimulFlow: Simultaneously Extracting Feature and Identifying Target for Unsupervised Video Object Segmentation
Unsupervised video object segmentation (UVOS) aims at detecting the primary objects in a given video sequence without any human interposing. Most existing methods rely on two-stream architectures that separately encode t…
Objectobject-detectionObject DetectionOptical Flow Estimation+6