paper-with-me

Papers

Flow-guided Semi-supervised Video Object Segmentation

2023-01-25 · Yushan Zhang, Andreas Robinson, Maria Magnusson, Michael Felsberg

We propose an optical flow-guided approach for semi-supervised video object segmentation. Optical flow is usually exploited as additional guidance information in unsupervised video object segmentation. However, its relevance in semi-supervised video object segmentation has not been fully explored. In this work, we follow an encoder-decoder approach to address the segmentation task. A model to extract the combined information from optical flow and the image is proposed, which is then used as input to the target model and the decoder network. Unlike previous methods where concatenation is used to integrate information from image data and optical flow, a simple yet effective attention mechanism is exploited in our work. Experiments on DAVIS 2017 and YouTube-VOS 2019 show that by integrating the information extracted from optical flow into the original image branch results in a strong performance gain and our method achieves state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2301.10492

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderObjectOptical Flow EstimationSegmentationSemantic SegmentationSemi-Supervised Video Object SegmentationUnsupervised Video Object SegmentationVideo Object SegmentationVideo Semantic Segmentation

Similar Papers 제목 키워드 기반

FAMINet: Learning Real-time Semi-supervised Video Object Segmentation with Steepest Optimized Optical Flow

2021-11-20 · Ziyang Liu, Jingmeng Liu, Weihai Chen, Xingming Wu 외

Semi-supervised video object segmentation (VOS) aims to segment a few moving objects in a video sequence, where these objects are specified by annotation of first frame. The optical flow has been considered in many exist…

Optical Flow EstimationSegmentationSemantic SegmentationSemi-Supervised Video Object Segmentation+2

Unsupervised Video Object Segmentation using Motion Saliency-Guided Spatio-Temporal Propagation

2018-09-04 · ECCV 2018 9 · Yuan-Ting Hu, Jia-Bin Huang, Alexander G. Schwing

Unsupervised video segmentation plays an important role in a wide variety of applications from object identification to compression. However, to date, fast motion, motion blur and occlusions pose significant challenges. …

Deep LearningOptical Flow EstimationSaliency PredictionSegmentation+6

BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation

2022-08-01 · Ye Yu, Jialin Yuan, Gaurav Mittal, Li Fuxin 외

Video Object Segmentation (VOS) is fundamental to video understanding. Transformer-based methods show significant performance improvement on semi-supervised VOS. However, existing work faces challenges segmenting visuall…

ObjectOptical Flow EstimationSegmentationSemantic Segmentation+5

FODVid: Flow-guided Object Discovery in Videos

2023-07-10 · Silky Singh, Shripad Deshmukh, Mausoom Sarkar, Rishabh Jain 외

Segmentation of objects in a video is challenging due to the nuances such as motion blurring, parallax, occlusions, changes in illumination, etc. Instead of addressing these nuances separately, we focus on building a gen…

ObjectObject DiscoveryObject Discovery In VideosSegmentation+3

Semi-Supervised Video Salient Object Detection Using Pseudo-Labels

2019-08-12 · ICCV 2019 10 · Pengxiang Yan, Guanbin Li, Yuan Xie, Zhen Li 외

Deep learning-based video salient object detection has recently achieved great success with its performance significantly outperforming any other unsupervised methods. However, existing data-driven approaches heavily rel…

object-detectionRGB Salient Object DetectionSalient Object DetectionUnsupervised Video Object Segmentation+1