PartImageNet: A Large, High-Quality Dataset of Parts
It is natural to represent objects in terms of their parts. This has the potential to improve the performance of algorithms for object recognition and segmentation but can also help for downstream tasks like activity recognition. Research on part-based models, however, is hindered by the lack of datasets with per-pixel part annotations. This is partly due to the difficulty and high cost of annotating object parts so it has rarely been done except for humans (where there exists a big literature on part-based models). To help address this problem, we propose PartImageNet, a large, high-quality dataset with part segmentation annotations. It consists of $158$ classes from ImageNet with approximately $24,000$ images. PartImageNet is unique because it offers part-level annotations on a general set of classes including non-rigid, articulated objects, while having an order of magnitude larger size compared to existing part datasets (excluding datasets of humans). It can be utilized for many vision tasks including Object Segmentation, Semantic Part Segmentation, Few-shot Learning and Part Discovery. We conduct comprehensive experiments which study these tasks and set up a set of baselines. The dataset and scripts are released at https://github.com/TACJu/PartImageNet.
Code (1)
Tasks
Activity RecognitionFew-Shot LearningObjectObject RecognitionSegmentationSemantic SegmentationTransfer LearningVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
PartImageNet++ Dataset: Enhancing Visual Models with High-Quality Part Annotations
To address the scarcity of high-quality part annotations in existing datasets, we introduce PartImageNet++ (PIN++), a dataset that provides detailed part annotations for all categories in ImageNet-1K. With 100 annotated …
Object SegmentationObject RecognitionFew-Shot LearningSPIN: Hierarchical Segmentation with Subpart Granularity in Natural Images
Hierarchical segmentation entails creating segmentations at varying levels of granularity. We introduce the first hierarchical semantic segmentation dataset with subpart annotations for natural images, which we call SPIN…
SegmentationSemantic SegmentationTowards Open-World Segmentation of Parts
Segmenting object parts such as cup handles and animal bodies is important in many real-world applications but requires more annotation effort. The largest dataset nowadays contains merely two hundred object categories, …
Contrastive LearningSegmentationPartImageNet++ Dataset: Scaling up Part-based Models for Robust Recognition
Deep learning-based object recognition systems can be easily fooled by various adversarial perturbations. One reason for the weak robustness may be that they do not have part-based inductive bias like the human recogniti…
Adversarial RobustnessInductive BiasObject RecognitionUnderstanding Multi-Granularity for Open-Vocabulary Part Segmentation
Open-vocabulary part segmentation (OVPS) is an emerging research area focused on segmenting fine-grained entities using diverse and previously unseen vocabularies. Our study highlights the inherent complexities of part s…
Open Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSegmentation