paper-with-me

Papers

Improving Unsupervised Video Object Segmentation via Fake Flow Generation

2024-07-16 · Suhwan Cho, Minhyeok Lee, Jungho Lee, Donghyeong Kim, Seunghoon Lee, Sungmin Woo, Sangyoun Lee

Unsupervised video object segmentation (VOS), also known as video salient object detection, aims to detect the most prominent object in a video at the pixel level. Recently, two-stream approaches that leverage both RGB images and optical flow maps have gained significant attention. However, the limited amount of training data remains a substantial challenge. In this study, we propose a novel data generation method that simulates fake optical flows from single images, thereby creating large-scale training data for stable network learning. Inspired by the observation that optical flow maps are highly dependent on depth maps, we generate fake optical flows by refining and augmenting the estimated depth maps of each image. By incorporating our simulated image-flow pairs, we achieve new state-of-the-art performance on all public benchmark datasets without relying on complex modules. We believe that our data generation method represents a potential breakthrough for future VOS research.

📄 PDF Abstract BibTeX arXiv:2407.11714

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject DetectionOptical Flow EstimationSalient Object DetectionSemantic SegmentationUnsupervised Video Object SegmentationVideo Object SegmentationVideo Salient Object DetectionVideo Semantic Segmentation

Methods 이 논문이 사용한 방법론

VOS VOS is a type of video object segmentation model consisting of two network components. The target appearance model consists of a light-weight module, which is learned during…

Similar Papers 제목 키워드 기반

Instance Embedding Transfer to Unsupervised Video Object Segmentation

2018-01-03 · CVPR 2018 6 · Siyang Li, Bryan Seybold, Alexey Vorobyov, Alireza Fathi 외

We propose a method for unsupervised video object segmentation by transferring the knowledge encapsulated in image-based instance embedding networks. The instance embedding network produces an embedding vector for each p…

ObjectOptical Flow EstimationSegmentationSemantic Segmentation+3

Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion

2022-05-16 · Subhabrata Choudhury, Laurynas Karazija, Iro Laina, Andrea Vedaldi 외

Motion, measured via optical flow, provides a powerful cue to discover and learn objects in images and videos. However, compared to using appearance, it has some blind spots, such as the fact that objects become invisibl…

Image SegmentationOptical Flow EstimationSegmentationSemantic Segmentation+4

FODVid: Flow-guided Object Discovery in Videos

2023-07-10 · Silky Singh, Shripad Deshmukh, Mausoom Sarkar, Rishabh Jain 외

Segmentation of objects in a video is challenging due to the nuances such as motion blurring, parallax, occlusions, changes in illumination, etc. Instead of addressing these nuances separately, we focus on building a gen…

ObjectObject DiscoveryObject Discovery In VideosSegmentation+3

Flow-guided Semi-supervised Video Object Segmentation

2023-01-25 · Yushan Zhang, Andreas Robinson, Maria Magnusson, Michael Felsberg

We propose an optical flow-guided approach for semi-supervised video object segmentation. Optical flow is usually exploited as additional guidance information in unsupervised video object segmentation. However, its relev…

DecoderObjectOptical Flow EstimationSegmentation+5

SimulFlow: Simultaneously Extracting Feature and Identifying Target for Unsupervised Video Object Segmentation

2023-11-30 · Lingyi Hong, Wei zhang, Shuyong Gao, Hong Lu 외

Unsupervised video object segmentation (UVOS) aims at detecting the primary objects in a given video sequence without any human interposing. Most existing methods rely on two-stream architectures that separately encode t…

Objectobject-detectionObject DetectionOptical Flow Estimation+6