Enhancing Object Discovery for Unsupervised Instance Segmentation and Object Detection
We propose Cut-Once-and-LEaRn (COLER), a simple approach for unsupervised instance segmentation and object detection. COLER first uses our developed CutOnce to generate coarse pseudo labels, then enables the detector to learn from these masks. CutOnce applies Normalized Cut (NCut) only once and does not rely on any clustering methods (e.g., K-Means), but it can generate multiple object masks in an image. Our work opens a new direction for NCut algorithm in multi-object segmentation. We have designed several novel yet simple modules that not only allow CutOnce to fully leverage the object discovery capabilities of self-supervised model, but also free it from reliance on mask post-processing. During training, COLER achieves strong performance without requiring specially designed loss functions for pseudo labels, and its performance is further improved through self-training. COLER is a zero-shot unsupervised model that outperforms previous state-of-the-art methods on multiple benchmarks. We believe our method can help advance the field of unsupervised object localization. Code is available at: https://github.com/Quantumcraft616/COLER.
Code (0)
등록된 구현이 없습니다.
Tasks
Unsupervised Instance SegmentationUnsupervised Object LocalizationObject SegmentationObject DetectionSimilar Papers 제목 키워드 기반
Image Segmentation-based Unsupervised Multiple Objects Discovery
Unsupervised object discovery aims to localize objects in images, while removing the dependence on annotations required by most deep learning-based methods. To address this problem, we propose a fully unsupervised, botto…
Class-agnostic Object DetectionImage SegmentationObjectobject-detection+4Unsupervised Discovery of the Long-Tail in Instance Segmentation Using Hierarchical Self-Supervision
Instance segmentation is an active topic in computer vision that is usually solved by using supervised learning approaches over very large datasets composed of object level masks. Obtaining such a dataset for any new dom…
Instance SegmentationNovel Object DetectionSegmentationSemantic SegmentationFreeSOLO: Learning to Segment Objects without Annotations
Instance segmentation is a fundamental vision task that aims to recognize and segment each object in an image. However, it requires costly annotations such as bounding boxes and segmentation masks for learning. In this w…
Instance Segmentationobject-detectionObject DetectionSegmentation+2K-means for unsupervised instance segmentation using a self-supervised transformer
Instance segmentation is a fundamental task in computer vision that assigns every pixel to an appropriate class and localizes objects into bounding boxes. However, collecting pixel-level segmentation labels is more reso…
Instance SegmentationObject DetectionObject DiscoverySegmentation+3DARCNN: Domain Adaptive Region-based Convolutional Neural Network for Unsupervised Instance Segmentation in Biomedical Images
In the biomedical domain, there is an abundance of dense, complex data where objects of interest may be challenging to detect or constrained by limits of human knowledge. Labelled domain specific datasets for supervised …
Domain AdaptationInstance SegmentationMedical Image Segmentationscientific discovery+3