Unsupervised Part Discovery from Contrastive Reconstruction
The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has received significantly less attention. In this paper, we propose an unsupervised approach to object part discovery and segmentation and make three contributions. First, we construct a proxy task through a set of objectives that encourages the model to learn a meaningful decomposition of the image into its parts. Secondly, prior work argues for reconstructing or clustering pre-computed features as a proxy to parts; we show empirically that this alone is unlikely to find meaningful parts; mainly because of their low resolution and the tendency of classification networks to spatially smear out information. We suggest that image reconstruction at the level of pixels can alleviate this problem, acting as a complementary cue. Lastly, we show that the standard evaluation based on keypoint regression does not correlate well with segmentation quality and thus introduce different metrics, NMI and ARI, that better characterize the decomposition of objects into parts. Our method yields semantic parts which are consistent across fine-grained but visually distinct categories, outperforming the state of the art on three benchmark datasets. Code is available at the project page: https://www.robots.ox.ac.uk/~vgg/research/unsup-parts/.
Code (1)
Tasks
Representation LearningUnsupervised Keypoint EstimationUnsupervised Part DiscoverySimilar Papers 제목 키워드 기반
CIC: Contrastive Intrinsic Control for Unsupervised Skill Discovery
We introduce Contrastive Intrinsic Control (CIC), an algorithm for unsupervised skill discovery that maximizes the mutual information between state-transitions and latent skill vectors. CIC utilizes contrastive learning …
Contrastive LearningDiversityreinforcement-learningReinforcement Learning (RL)+1Weakly-supervised Contrastive Learning for Unsupervised Object Discovery
Unsupervised object discovery (UOD) refers to the task of discriminating the whole region of objects from the background within a scene without relying on labeled datasets, which benefits the task of bounding-box-level l…
Contrastive LearningImage ReconstructionObjectObject Discovery+2HEAP: Unsupervised Object Discovery and Localization with Contrastive Grouping
Unsupervised object discovery and localization aims to detect or segment objects in an image without any supervision. Recent efforts have demonstrated a notable potential to identify salient foreground objects by utilizi…
ObjectObject DiscoverySaliency DetectionSemantic SegmentationControllable Discovery of Intents: Incremental Deep Clustering Using Semi-Supervised Contrastive Learning
Deriving value from a conversational AI system depends on the capacity of a user to translate the prior knowledge into a configuration. In most cases, discovering the set of relevant turn-level speaker intents is often o…
ClusteringContinual LearningContrastive LearningDeep Clustering+2ComSD: Balancing Behavioral Quality and Diversity in Unsupervised Skill Discovery
This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Unsupervised skill discovery seeks to acquire differen…
Contrastive LearningDiversityReinforcement Learning (RL)Unsupervised Reinforcement Learning