paper-with-me

Papers

Zero-Shot Instance Segmentation

2021-04-14 · CVPR 2021 1 · Ye Zheng, JiaHong Wu, Yongqiang Qin, Faen Zhang, Li Cui

Deep learning has significantly improved the precision of instance segmentation with abundant labeled data. However, in many areas like medical and manufacturing, collecting sufficient data is extremely hard and labeling this data requires high professional skills. We follow this motivation and propose a new task set named zero-shot instance segmentation (ZSI). In the training phase of ZSI, the model is trained with seen data, while in the testing phase, it is used to segment all seen and unseen instances. We first formulate the ZSI task and propose a method to tackle the challenge, which consists of Zero-shot Detector, Semantic Mask Head, Background Aware RPN and Synchronized Background Strategy. We present a new benchmark for zero-shot instance segmentation based on the MS-COCO dataset. The extensive empirical results in this benchmark show that our method not only surpasses the state-of-the-art results in zero-shot object detection task but also achieves promising performance on ZSI. Our approach will serve as a solid baseline and facilitate future research in zero-shot instance segmentation.

📄 PDF Abstract BibTeX arXiv:2104.06601

Code (4)

zhengye1995/Zero-shot-Instance-Segmentation 공식 구현 pytorch
https://dagshub.com/f2010126/Zero-shot-Instance-Segmentation
E-DEEP/PapersReview
KennithLi/Awesome-Zero-Shot-Object-Detection

Tasks

Instance Segmentationobject-detectionObject DetectionSegmentationSemantic SegmentationZero-Shot Instance SegmentationZero-Shot Object Detection

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Similar Papers 제목 키워드 기반

Zero-shot Unsupervised Transfer Instance Segmentation

2023-04-27 · Gyungin Shin, Samuel Albanie, Weidi Xie

Segmentation is a core computer vision competency, with applications spanning a broad range of scientifically and economically valuable domains. To date, however, the prohibitive cost of annotation has limited the deploy…

Instance SegmentationSegmentationSemantic Segmentation

PanopticRecon: Leverage Open-vocabulary Instance Segmentation for Zero-shot Panoptic Reconstruction

2024-07-01 · Xuan Yu, Yili Liu, Chenrui Han, Sitong Mao 외

Panoptic reconstruction is a challenging task in 3D scene understanding. However, most existing methods heavily rely on pre-trained semantic segmentation models and known 3D object bounding boxes for 3D panoptic segmenta…

3D Panoptic SegmentationInstance SegmentationPanoptic SegmentationScene Understanding+3

Zero-shot Hierarchical Plant Segmentation via Foundation Segmentation Models and Text-to-image Attention

2025-09-11 · Junhao Xing, Ryohei Miyakawa, Yang Yang, Xinpeng Liu 외 arxiv

Foundation segmentation models achieve reasonable leaf instance extraction from top-view crop images without training (i.e., zero-shot). However, segmenting entire plant individuals with each consisting of multiple overl…

Generalization vs. Specialization: Evaluating Segment Anything Model (SAM3) Zero-Shot Segmentation Against Fine-Tuned YOLO Detectors

2025-12-09 · Ranjan Sapkota, Konstantinos I. Roumeliotis, Manoj Karkee, Nikolaos D. Tselikas arxiv

Deep learning has advanced two fundamentally different paradigms for instance segmentation: specialized models optimized through task-specific fine-tuning and generalist foundation models capable of zero-shot segmentatio…

Instance Segmentation

OnlineAnySeg: Online Zero-Shot 3D Segmentation by Visual Foundation Model Guided 2D Mask Merging

2025-03-03 · CVPR 2025 1 · Yijie Tang, Jiazhao Zhang, Yuqing Lan, Yulan Guo 외

Online zero-shot 3D instance segmentation of a progressively reconstructed scene is both a critical and challenging task for embodied applications. With the success of visual foundation models (VFMs) in the image domain,…

3D Instance SegmentationInstance Segmentationopen vocabulary 3d instance segmentationSegmentation+1