MaskRNN: Instance Level Video Object Segmentation

2018-03-29 · NeurIPS 2017 12 · Yuan-Ting Hu, Jia-Bin Huang, Alexander G. Schwing

Instance level video object segmentation is an important technique for video editing and compression. To capture the temporal coherence, in this paper, we develop MaskRNN, a recurrent neural net approach which fuses in each frame the output of two deep nets for each object instance -- a binary segmentation net providing a mask and a localization net providing a bounding box. Due to the recurrent component and the localization component, our method is able to take advantage of long-term temporal structures of the video data as well as rejecting outliers. We validate the proposed algorithm on three challenging benchmark datasets, the DAVIS-2016 dataset, the DAVIS-2017 dataset, and the Segtrack v2 dataset, achieving state-of-the-art performance on all of them.

📄 PDF Abstract BibTeX arXiv:1803.11187

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectSegmentation Semantic SegmentationVideo EditingVideo Object Segmentation Video Semantic Segmentation

Instance-Level Video Segmentation From Object Tracks

2016-06-01 · CVPR 2016 6 · Guillaume Seguin, Piotr Bojanowski, Remi Lajugie, Ivan Laptev

We address the problem of segmenting multiple object instances in complex videos. Our method does not require manual pixel-level annotation for training, and relies instead on readily-available object detectors or visual…

Clustering Object Object Tracking Segmentation+4

Classifying, Segmenting, and Tracking Object Instances in Video with Mask Propagation

2019-12-10 · CVPR 2020 6 · Gedas Bertasius, Lorenzo Torresani

We introduce a method for simultaneously classifying, segmenting and tracking object instances in a video sequence. Our method, named MaskProp, adapts the popular Mask R-CNN to video by adding a mask propagation branch t…

Instance Segmentation Object Segmentation Semantic Segmentation+1

Learning to Segment Instances in Videos with Spatial Propagation Network

2017-09-14 · Jingchun Cheng, Sifei Liu, Yi-Hsuan Tsai, Wei-Chih Hung 외

We propose a deep learning-based framework for instance-level object segmentation. Our method mainly consists of three steps. First, We train a generic model based on ResNet-101 for foreground/background segmentations. S…

Object Segmentation Semantic Segmentation

InstMove: Instance Motion for Object-centric Video Segmentation

2023-03-14 · CVPR 2023 1 · Qihao Liu, Junfeng Wu, Yi Jiang, Xiang Bai 외

Despite significant efforts, cutting-edge video segmentation methods still remain sensitive to occlusion and rapid movement, due to their reliance on the appearance of objects in the form of object embeddings, which are …

Object Optical Flow Estimation Segmentation Video Segmentation+1

A2VIS: Amodal-Aware Approach to Video Instance Segmentation

2024-12-02 · Minh Tran, Thang Pham, Winston Bounsavy, Tri Nguyen 외

Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video…

Instance Segmentation Multiple Object Tracking Object Object Tracking+3