Weakly Supervised Instance Segmentation using Motion Information via Optical Flow

2022-02-25 · Jun Ikeda, Junichiro Mori

Weakly supervised instance segmentation has gained popularity because it reduces high annotation cost of pixel-level masks required for model training. Recent approaches for weakly supervised instance segmentation detect and segment objects using appearance information obtained from a static image. However, it poses the challenge of identifying objects with a non-discriminatory appearance. In this study, we address this problem by using motion information from image sequences. We propose a two-stream encoder that leverages appearance and motion features extracted from images and optical flows. Additionally, we propose a novel pairwise loss that considers both appearance and motion information to supervise segmentation. We conducted extensive evaluations on the YouTube-VIS 2019 benchmark dataset. Our results demonstrate that the proposed method improves the Average Precision of the state-of-the-art method by 3.1.

📄 PDF Abstract BibTeX arXiv:2202.13006

Code (0)

등록된 구현이 없습니다.

Tasks

Instance Segmentation Optical Flow Estimation Segmentation Semantic Segmentation Weakly-supervised instance segmentation

Weakly Supervised Instance Segmentation for Videos with Temporal Mask Consistency

2021-03-23 · CVPR 2021 1 · Qing Liu, Vignesh Ramanathan, Dhruv Mahajan, Alan Yuille 외

Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) parti…

Instance Segmentation Relation Network Segmentation Semantic Segmentation+1

Transformer based multiple instance learning for weakly supervised histopathology image segmentation

2022-05-18 · Ziniu Qian, Kailu Li, Maode Lai, Eric I-Chao Chang 외

Hispathological image segmentation algorithms play a critical role in computer aided diagnosis technology. The development of weakly supervised segmentation algorithm alleviates the problem of medical image annotation th…

Image Segmentation Multiple Instance Learning Segmentation Semantic Segmentation+2

Associating Inter-Image Salient Instances for Weakly Supervised Semantic Segmentation

2018-09-01 · ECCV 2018 9 · Ruochen Fan, Qibin Hou, Ming-Ming Cheng, Gang Yu 외

Effectively bridging between image level keyword annotations and corresponding image pixels is one of the main challenges in weakly supervised semantic segmentation. In this paper, we use an instance-level salient object…

Clustering graph partitioning Image-level Supervised Instance Segmentation Instance Segmentation+6

Weakly Supervised Multi-Object Tracking and Segmentation

2021-01-03 · Idoia Ruiz, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder 외

We introduce the problem of weakly supervised Multi-Object Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi-object tracking, in which we do not provide any kind of mask annotation. …

Instance Segmentation Multi-Object Tracking Multi-Object Tracking and Segmentation Multi-Task Learning+6

BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentation

2021-03-16 · CVPR 2021 1 · Jungbeom Lee, Jihun Yi, Chaehun Shin, Sungroh Yoon

Weakly supervised segmentation methods using bounding box annotations focus on obtaining a pixel-level mask from each box containing an object. Existing methods typically depend on a class-agnostic mask generator, which …

Box-supervised Instance Segmentation Instance Segmentation Object Segmentation+4