paper-with-me

홈 › Papers

Learning to Segment Every Thing

2017-11-28 · CVPR 2018 6 · Ronghang Hu, Piotr Dollár, Kaiming He, Trevor Darrell, Ross Girshick

Most methods for object instance segmentation require all training examples to be labeled with segmentation masks. This requirement makes it expensive to annotate new categories and has restricted instance segmentation models to ~100 well-annotated classes. The goal of this paper is to propose a new partially supervised training paradigm, together with a novel weight transfer function, that enables training instance segmentation models on a large set of categories all of which have box annotations, but only a small fraction of which have mask annotations. These contributions allow us to train Mask R-CNN to detect and segment 3000 visual concepts using box annotations from the Visual Genome dataset and mask annotations from the 80 classes in the COCO dataset. We evaluate our approach in a controlled study on the COCO dataset. This work is a first step towards instance segmentation models that have broad comprehension of the visual world.

📄 PDF Abstract BibTeX arXiv:1711.10370

Code (3)

facebookresearch/detectron pytorch
jiajunhua/facebookresearch-Detectron caffe2
ronghanghu/seg_every_thing caffe2

Tasks

Instance SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Edit Everything: A Text-Guided Generative System for Images Editing

2023-04-27 · Defeng Xie, Ruichen Wang, Jian Ma, Chen Chen 외

We introduce a new generative system called Edit Everything, which can take image and text inputs and produce image outputs. Edit Everything allows users to edit images using simple text instructions. Our system designs …

MobileSAMv2: Faster Segment Anything to Everything

2023-12-15 · Chaoning Zhang, Dongshen Han, Sheng Zheng, Jinwoo Choi 외

Segment anything model (SAM) addresses two practical yet challenging segmentation tasks: \textbf{segment anything (SegAny)}, which utilizes a certain point to predict the mask for a single object of interest, and \textbf…

DecoderKnowledge DistillationObject Discoveryvalid

Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation

2024-11-28 · Finlay G. C. Hudson, William A. P. Smith

We present Track Anything Behind Everything (TABE), a novel dataset, pipeline, and evaluation framework for zero-shot amodal completion from visible masks. Unlike existing methods that require pretrained class labels, ou…

3D ReconstructionSegmentationSemantic SegmentationVideo Object Segmentation+1

TinySAM: Pushing the Envelope for Efficient Segment Anything Model

2023-12-21 · Han Shu, Wenshuo Li, Yehui Tang, Yiman Zhang 외

Recently segment anything model (SAM) has shown powerful segmentation capability and has drawn great attention in computer vision fields. Massive following works have developed various applications based on the pre-train…

Knowledge DistillationQuantization

SegGPT: Segmenting Everything In Context

2023-04-06 · Xinlong Wang, Xiaosong Zhang, Yue Cao, Wen Wang 외

We present SegGPT, a generalist model for segmenting everything in context. We unify various segmentation tasks into a generalist in-context learning framework that accommodates different kinds of segmentation data by tr…

Few-Shot Semantic SegmentationIn-Context LearningPanoptic SegmentationPersonalized Segmentation+4