Large-scale Unsupervised Semantic Segmentation
Empowered by large datasets, e.g., ImageNet, unsupervised learning on large-scale data has enabled significant advances for classification tasks. However, whether the large-scale unsupervised semantic segmentation can be achieved remains unknown. There are two major challenges: i) we need a large-scale benchmark for assessing algorithms; ii) we need to develop methods to simultaneously learn category and shape representation in an unsupervised manner. In this work, we propose a new problem of large-scale unsupervised semantic segmentation (LUSS) with a newly created benchmark dataset to help the research progress. Building on the ImageNet dataset, we propose the ImageNet-S dataset with 1.2 million training images and 50k high-quality semantic segmentation annotations for evaluation. Our benchmark has a high data diversity and a clear task objective. We also present a simple yet effective method that works surprisingly well for LUSS. In addition, we benchmark related un/weakly/fully supervised methods accordingly, identifying the challenges and possible directions of LUSS. The benchmark and source code is publicly available at https://github.com/LUSSeg.
Code (3)
Tasks
DiversityRepresentation LearningSegmentationSemantic SegmentationUnsupervised Semantic SegmentationSimilar Papers 제목 키워드 기반
TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation
Unsupervised semantic segmentation aims to obtain high-level semantic representation on low-level visual features without manual annotations. Most existing methods are bottom-up approaches that try to group pixels into r…
SegmentationSelf-Supervised LearningSemantic SegmentationUnsupervised Semantic SegmentationUnsupervised Chinese Word Segmentation with BERT Oriented Probing and Transformation
Word Segmentation is a fundamental step for understanding Chinese language. Previous neural approaches for unsupervised Chinese Word Segmentation (CWS) only exploits shallow semantic information, which can miss important…
Chinese Word SegmentationSegmentationUnsupervised Chinese Word Segmentation with BERT Oriented Probing and Transformation
Word Segmentation is a fundamental step for understanding Chinese language. Previous neural approaches for unsupervised Chinese Word Segmentation (CWS) only exploits shallow semantic information, which can miss important…
Chinese Word SegmentationSegmentationDatUS^2: Data-driven Unsupervised Semantic Segmentation with Pre-trained Self-supervised Vision Transformer
Successive proposals of several self-supervised training schemes continue to emerge, taking one step closer to developing a universal foundation model. In this process, the unsupervised downstream tasks are recognized as…
SegmentationSemantic SegmentationUnsupervised Semantic SegmentationGeometric Unsupervised Domain Adaptation for Semantic Segmentation
Simulators can efficiently generate large amounts of labeled synthetic data with perfect supervision for hard-to-label tasks like semantic segmentation. However, they introduce a domain gap that severely hurts real-world…
Depth EstimationDepth PredictionDomain AdaptationMonocular Depth Estimation+3