paper-with-me

홈 › Papers

Generative Hierarchical Models for Parts, Objects, and Scenes

2019-10-21 · Fei Deng, Zhuo Zhi, Sungjin Ahn

Compositional structures between parts and objects are inherent in natural scenes. Modeling such compositional hierarchies via unsupervised learning can bring various benefits such as interpretability and transferability, which are important in many downstream tasks. In this paper, we propose the first deep latent variable model, called RICH, for learning Representation of Interpretable Compositional Hierarchies. At the core of RICH is a latent scene graph representation that organizes the entities of a scene into a tree structure according to their compositional relationships. During inference, taking top-down approach, RICH is able to use higher-level representation to guide lower-level decomposition. This avoids the difficult problem of routing between parts and objects that is faced by bottom-up approaches. In experiments on images containing multiple objects with different part compositions, we demonstrate that RICH is able to learn the latent compositional hierarchy and generate imaginary scenes.

📄 PDF Abstract BibTeX arXiv:1910.09119

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

Generative Scene Graph Networks

2021-01-01 · ICLR 2021 1 · Fei Deng, Zhuo Zhi, Donghun Lee, Sungjin Ahn

Human perception excels at building compositional hierarchies of parts and objects from unlabeled scenes that help systematic generalization. Yet most work on generative scene modeling either ignores the part-whole relat…

Systematic Generalization

Recursive Neural Programs: Variational Learning of Image Grammars and Part-Whole Hierarchies

2022-06-16 · Ares Fisher, Rajesh P. N. Rao

Human vision involves parsing and representing objects and scenes using structured representations based on part-whole hierarchies. Computer vision and machine learning researchers have recently sought to emulate this ca…

Transfer Learning

Towards causal generative scene models via competition of experts

2020-04-27 · Julius von Kügelgen, Ivan Ustyuzhaninov, Peter Gehler, Matthias Bethge 외

Learning how to model complex scenes in a modular way with recombinable components is a pre-requisite for higher-order reasoning and acting in the physical world. However, current generative models lack the ability to ca…

Inductive BiasObject

gCoRF: Generative Compositional Radiance Fields

2022-10-31 · Mallikarjun BR, Ayush Tewari, Xingang Pan, Mohamed Elgharib 외

3D generative models of objects enable photorealistic image synthesis with 3D control. Existing methods model the scene as a global scene representation, ignoring the compositional aspect of the scene. Compositional reas…

Image Generation

Scan2Part: Fine-grained and Hierarchical Part-level Understanding of Real-World 3D Scans

2022-06-06 · Alexandr Notchenko, Vladislav Ishimtsev, Alexey Artemov, Vadim Selyutin 외

We propose Scan2Part, a method to segment individual parts of objects in real-world, noisy indoor RGB-D scans. To this end, we vary the part hierarchies of objects in indoor scenes and explore their effect on scene under…

Scene Understanding