Unsupervised 3D Structure Inference from Category-Specific Image Collections
Understanding 3D object structure from image collections of general object categories remains a long-standing challenge in computer vision. Due to the high relevance of image keypoints (e.g. for graph matching controlling generative models scene understanding etc.) in this work we specifically focus on inferring 3D structure in terms of sparse keypoints. Existing 3D keypoint inference approaches rely on strong priors such as spatio-temporal consistency multi-view images of the same object 3D shape priors (e.g. templates skeleton) or supervisory signals e.g. in the form of 2D keypoint annotations. In contrast we propose the first unsupervised 3D keypoint inference approach that can be trained for general object categories solely from an inhomogeneous image collection (containing different instances of objects from the same category). Our experiments show that our method not only improves upon unsupervised 2D keypoint inference but more importantly it also produces reasonable 3D structure for various object categories both qualitatively and quantitatively.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph MatchingObjectScene UnderstandingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adaptive Scene Category Discovery with Generative Learning and Compositional Sampling
This paper investigates a general framework to discover categories of unlabeled scene images according to their appearances (i.e., textures and structures). We jointly solve the two coupled tasks in an unsupervised manne…
Image CategorizationReference-based Category Discovery: Unsupervised Object Detection with Category Awareness
Traditional one-shot detection methods have addressed the closed-set problem in object detection, but the high cost of data annotation remains a critical challenge. General unsupervised methods generate pseudo boxes with…
Object DetectionUSEEK: Unsupervised SE(3)-Equivariant 3D Keypoints for Generalizable Manipulation
Can a robot manipulate intra-category unseen objects in arbitrary poses with the help of a mere demonstration of grasping pose on a single object instance? In this paper, we try to address this intriguing challenge by us…
Keypoint DetectionObjectUnsupervised Learning with Imbalanced Data via Structure Consolidation Latent Variable Model
Unsupervised learning on imbalanced data is challenging because, when given imbalanced data, current model is often dominated by the major category and ignores the categories with small amount of data. We develop a laten…
Variational InferenceUnsupervised Part Discovery via Feature Alignment
Understanding objects in terms of their individual parts is important, because it enables a precise understanding of the objects' geometrical structure, and enhances object recognition when the object is seen in a novel …
ObjectObject RecognitionUnsupervised Part Discovery