paper-with-me

Papers

FreeSOLO: Learning to Segment Objects without Annotations

2022-02-24 · CVPR 2022 1 · Xinlong Wang, Zhiding Yu, Shalini De Mello, Jan Kautz, Anima Anandkumar, Chunhua Shen, Jose M. Alvarez

Instance segmentation is a fundamental vision task that aims to recognize and segment each object in an image. However, it requires costly annotations such as bounding boxes and segmentation masks for learning. In this work, we propose a fully unsupervised learning method that learns class-agnostic instance segmentation without any annotations. We present FreeSOLO, a self-supervised instance segmentation framework built on top of the simple instance segmentation method SOLO. Our method also presents a novel localization-aware pre-training framework, where objects can be discovered from complicated scenes in an unsupervised manner. FreeSOLO achieves 9.8% AP_{50} on the challenging COCO dataset, which even outperforms several segmentation proposal methods that use manual annotations. For the first time, we demonstrate unsupervised class-agnostic instance segmentation successfully. FreeSOLO's box localization significantly outperforms state-of-the-art unsupervised object detection/discovery methods, with about 100% relative improvements in COCO AP. FreeSOLO further demonstrates superiority as a strong pre-training method, outperforming state-of-the-art self-supervised pre-training methods by +9.8% AP when fine-tuning instance segmentation with only 5% COCO masks. Code is available at: github.com/NVlabs/FreeSOLO

📄 PDF Abstract BibTeX arXiv:2202.12181

Code (1)

nvlabs/freesolo 공식 구현 pytorch

Tasks

Instance Segmentationobject-detectionObject DetectionSegmentationSemantic SegmentationUnsupervised Object Detection

Similar Papers 제목 키워드 기반

Exemplar-FreeSOLO: Enhancing Unsupervised Instance Segmentation With Exemplars

2023-01-01 · CVPR 2023 1 · Taoseef Ishtiak, Qing En, Yuhong Guo

Instance segmentation seeks to identify and segment each object from images, which often relies on a large number of dense annotations for model training. To alleviate this burden, unsupervised instance segmentation …

Instance SegmentationSegmentationSemantic SegmentationUnsupervised Instance Segmentation

PM-VIS+: High-Performance Video Instance Segmentation without Video Annotation

2024-06-28 · Zhangjing Yang, Dun Liu, Xin Wang, Zhe Li 외

Video instance segmentation requires detecting, segmenting, and tracking objects in videos, typically relying on costly video annotations. This paper introduces a method that eliminates video annotations by utilizing ima…

Instance SegmentationSegmentationSemantic SegmentationVideo Instance Segmentation

Deep Metric Learning for Open World Semantic Segmentation

2021-08-10 · ICCV 2021 10 · Jun Cen, Peng Yun, Junhao Cai, Michael Yu Wang 외

Classical close-set semantic segmentation networks have limited ability to detect out-of-distribution (OOD) objects, which is important for safety-critical applications such as autonomous driving. Incrementally learning …

Autonomous DrivingFew-Shot LearningMetric LearningSegmentation+1

CobNet: Cross Attention on Object and Background for Few-Shot Segmentation

2022-10-21 · Haoyan Guan, Michael Spratling

Few-shot segmentation aims to segment images containing objects from previously unseen classes using only a few annotated samples. Most current methods focus on using object information extracted, with the aid of human a…

Segmentation

ONeRF: Unsupervised 3D Object Segmentation from Multiple Views

2022-11-22 · Shengnan Liang, Yichen Liu, Shangzhe Wu, Yu-Wing Tai 외

We present ONeRF, a method that automatically segments and reconstructs object instances in 3D from multi-view RGB images without any additional manual annotations. The segmented 3D objects are represented using separate…

3D scene EditingObjectSemantic Segmentation