A Generative Model for Parts-based Object Segmentation
The Shape Boltzmann Machine (SBM) has recently been introduced as a state-of-the-art model of foreground/background object shape. We extend the SBM to account for the foreground object's parts. Our model, the Multinomial SBM (MSBM), can capture both local and global statistics of part shapes accurately. We combine the MSBM with an appearance model to form a fully generative model of images of objects. Parts-based image segmentations are obtained simply by performing probabilistic inference in the model. We apply the model to two challenging datasets which exhibit significant shape and appearance variability, and find that it obtains results that are comparable to the state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
modelObjectSemantic SegmentationSimilar Papers 제목 키워드 기반
gCoRF: Generative Compositional Radiance Fields
3D generative models of objects enable photorealistic image synthesis with 3D control. Existing methods model the scene as a global scene representation, ignoring the compositional aspect of the scene. Compositional reas…
Image GenerationParts-Based Articulated Object Localization in Clutter Using Belief Propagation
Robots working in human environments must be able to perceive and act on challenging objects with articulations, such as a pile of tools. Articulated objects increase the dimensionality of the pose estimation problem, an…
ObjectObject LocalizationPose EstimationHarnessing Generative Image Models for Training-Free Primitive Shape Abstraction
Representing 3D shapes as compact sets of geometric primitives is fundamental to robotics, simulation, and scene understanding. Generative image models trained at scale have recently emerged as generalist visual learners…
Scene UnderstandingPartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models
Text- or image-to-3D generators and 3D scanners can now produce 3D assets with high-quality shapes and textures. These assets typically consist of a single, fused representation, like an implicit neural field, a Gaussian…
3D Generation3D ReconstructionImage to 3DObjectRobust Instance Segmentation through Reasoning about Multi-Object Occlusion
Analyzing complex scenes with Deep Neural Networks is a challenging task, particularly when images contain multiple objects that partially occlude each other. Existing approaches to image analysis mostly process objects …
image-classificationImage ClassificationInstance SegmentationObject+2