Shape and Positional Geometry of Multi-Object Configurations
In previous work, we introduced a method for modeling a configuration of objects in 2D and 3D images using a mathematical "medial/skeletal linking structure." In this paper, we show how these structures allow us to capture positional properties of a multi-object configuration in addition to the shape properties of the individual objects. In particular, we introduce numerical invariants for positional properties which measure the closeness of neighboring objects, including identifying the parts of the objects which are close, and the "relative significance" of objects compared with the other objects in the configuration. Using these numerical measures, we introduce a hierarchical ordering and relations between the individual objects, and quantitative criteria for identifying subconfigurations. In addition, the invariants provide a "proximity matrix" which yields a unique set of weightings measuring overall proximity of objects in the configuration. Furthermore, we show that these invariants, which are volumetrically defined and involve external regions, may be computed via integral formulas in terms of "skeletal linking integrals" defined on the internal skeletal structures of the objects.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectSimilar Papers 제목 키워드 기반
Learning a Hierarchical Compositional Shape Vocabulary for Multi-class Object Representation
Hierarchies allow feature sharing between objects at multiple levels of representation, can code exponential variability in a very compact way and enable fast inference. This makes them potentially suitable for learning …
ObjectLearning Partonomic 3D Reconstruction from Image Collections
Reconstructing the 3D shape of an object from a single-view image is a fundamental task in computer vision. Recent advances in differentiable rendering have enabled 3D reconstruction from image collections using only…
3D ReconstructionImage GenerationObjectObject ReconstructionModeling Multi-Object Configurations via Medial/Skeletal Linking Structures
We introduce a method for modeling a configuration of objects in 2D or 3D images using a mathematical "skeletal linking structure" which will simultaneously capture the individual shape features of the objects and their …
ObjectSCENEFORGE: Enhancing 3D-text alignment with Structured Scene Compositions
The whole is greater than the sum of its parts-even in 3D-text contrastive learning. We introduce SceneForge, a novel framework that enhances contrastive alignment between 3D point clouds and text through structured mult…
Visual Question AnsweringContrastive LearningSpatial ReasoningPoint CloudsReconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observations
Accurately reconstructing complex full multi-object scenes from sparse observations remains a core challenge in computer vision and a key step toward scalable and reliable simulation for robotics. In this work, we introd…
Scene GenerationPose Estimation