paper-with-me

Papers

DAVOS: Semi-Supervised Video Object Segmentation via Adversarial Domain Adaptation

2021-05-21 · Jinshuo Zhang, Zhicheng Wang, Songyan Zhang, Gang Wei

Domain shift has always been one of the primary issues in video object segmentation (VOS), for which models suffer from degeneration when tested on unfamiliar datasets. Recently, many online methods have emerged to narrow the performance gap between training data (source domain) and test data (target domain) by fine-tuning on annotations of test data which are usually in shortage. In this paper, we propose a novel method to tackle domain shift by first introducing adversarial domain adaptation to the VOS task, with supervised training on the source domain and unsupervised training on the target domain. By fusing appearance and motion features with a convolution layer, and by adding supervision onto the motion branch, our model achieves state-of-the-art performance on DAVIS2016 with 82.6% mean IoU score after supervised training. Meanwhile, our adversarial domain adaptation strategy significantly raises the performance of the trained model when applied on FBMS59 and Youtube-Object, without exploiting extra annotations.

📄 PDF Abstract BibTeX arXiv:2105.10201

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object SegmentationVideo Semantic Segmentation

Methods 이 논문이 사용한 방법론

VOS VOS is a type of video object segmentation model consisting of two network components. The target appearance model consists of a light-weight module, which is learned during…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Flow-guided Semi-supervised Video Object Segmentation

2023-01-25 · Yushan Zhang, Andreas Robinson, Maria Magnusson, Michael Felsberg

We propose an optical flow-guided approach for semi-supervised video object segmentation. Optical flow is usually exploited as additional guidance information in unsupervised video object segmentation. However, its relev…

DecoderObjectOptical Flow EstimationSegmentation+5

FAMINet: Learning Real-time Semi-supervised Video Object Segmentation with Steepest Optimized Optical Flow

2021-11-20 · Ziyang Liu, Jingmeng Liu, Weihai Chen, Xingming Wu 외

Semi-supervised video object segmentation (VOS) aims to segment a few moving objects in a video sequence, where these objects are specified by annotation of first frame. The optical flow has been considered in many exist…

Optical Flow EstimationSegmentationSemantic SegmentationSemi-Supervised Video Object Segmentation+2

The Second Place Solution for The 4th Large-scale Video Object Segmentation Challenge--Track 3: Referring Video Object Segmentation

2022-06-24 · Leilei Cao, Zhuang Li, Bo Yan, Feng Zhang 외

The referring video object segmentation task (RVOS) aims to segment object instances in a given video referred by a language expression in all video frames. Due to the requirement of understanding cross-modal semantics w…

Objectobject-detectionObject DetectionReferring Video Object Segmentation+5

CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing

2019-09-30 · ICCV 2019 10 · Kevin Duarte, Yogesh S Rawat, Mubarak Shah

In this work we propose a capsule-based approach for semi-supervised video object segmentation. Current video object segmentation methods are frame-based and often require optical flow to capture temporal consistency acr…

ObjectOne-shot visual object segmentationOptical Flow EstimationSegmentation+5

Maximal Cliques on Multi-Frame Proposal Graph for Unsupervised Video Object Segmentation

2023-01-29 · Jialin Yuan, Jay Patravali, Hung Nguyen, Chanho Kim 외

Unsupervised Video Object Segmentation (UVOS) aims at discovering objects and tracking them through videos. For accurate UVOS, we observe if one can locate precise segment proposals on key frames, subsequent processes ar…

Instance SegmentationObjectSegmentationSemantic Segmentation+4