Deep Extreme Cut: From Extreme Points to Object Segmentation
This paper explores the use of extreme points in an object (left-most, right-most, top, bottom pixels) as input to obtain precise object segmentation for images and videos. We do so by adding an extra channel to the image in the input of a convolutional neural network (CNN), which contains a Gaussian centered in each of the extreme points. The CNN learns to transform this information into a segmentation of an object that matches those extreme points. We demonstrate the usefulness of this approach for guided segmentation (grabcut-style), interactive segmentation, video object segmentation, and dense segmentation annotation. We show that we obtain the most precise results to date, also with less user input, in an extensive and varied selection of benchmarks and datasets. All our models and code are publicly available on http://www.vision.ee.ethz.ch/~cvlsegmentation/dextr/.
Code (2)
Tasks
Instance SegmentationInteractive SegmentationObjectSegmentationSemantic SegmentationVideo Object SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FAIRS -- Soft Focus Generator and Attention for Robust Object Segmentation from Extreme Points
Semantic segmentation from user inputs has been actively studied to facilitate interactive segmentation for data annotation and other applications. Recent studies have shown that extreme points can be effectively used to…
Interactive SegmentationSegmentationSemantic SegmentationExtreme clicking for efficient object annotation
Manually annotating object bounding boxes is central to building computer vision datasets, and it is very time consuming (annotating ILSVRC [53] took 35s for one high-quality box [62]). It involves clicking on imaginary …
ObjectS4M: Segment Anything with 4 Extreme Points
The Segment Anything Model (SAM) has revolutionized open-set interactive image segmentation, inspiring numerous adapters for the medical domain. However, SAM primarily relies on sparse prompts such as point or bounding b…
Image SegmentationInstance SegmentationSemantic SegmentationExtreme Point Supervised Instance Segmentation
This paper introduces a novel approach to learning instance segmentation using extreme points, i.e., the topmost, leftmost, bottommost, and rightmost points, of each object. These points are readily available in the mode…
Instance SegmentationPoint-Supervised Instance SegmentationPseudo LabelSegmentation+1Inter Extreme Points Geodesics for End-to-End Weakly Supervised Image Segmentation
We introduce $\textit{InExtremIS}$, a weakly supervised 3D approach to train a deep image segmentation network using particularly weak train-time annotations: only 6 extreme clicks at the boundary of the objects of inter…
Image SegmentationSegmentationSemantic SegmentationWeakly supervised segmentation