Compact Scene Graphs for Layout Composition and Patch Retrieval
Structured representations such as scene graphs serve as an efficient and compact representation that can be used for downstream rendering or retrieval tasks. However, existing efforts to generate realistic images from scene graphs perform poorly on scene composition for cluttered or complex scenes. We propose two contributions to improve the scene composition. First, we enhance the scene graph representation with heuristic-based relations, which add minimal storage overhead. Second, we use extreme points representation to supervise the learning of the scene composition network. These methods achieve significantly higher performance over existing work (69.0% vs 51.2% in relation score metric). We additionally demonstrate how scene graphs can be used to retrieve pose-constrained image patches that are semantically similar to the source query. Improving structured scene graph representations for rendering or retrieval is an important step towards realistic image generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationRetrievalSimilar Papers 제목 키워드 기반
SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequences
We introduce SceneLinker, a novel framework that generates compositional 3D scenes via semantic scene graph from RGB sequences. To adaptively experience Mixed Reality (MR) content based on each user's space, it is essent…
Scene GenerationScene Graph Disentanglement and Composition for Generalizable Complex Image Generation
There has been exciting progress in generating images from natural language or layout conditions. However, these methods struggle to faithfully reproduce complex scenes due to the insufficient modeling of multiple object…
DisentanglementImage GenerationModeling Image Composition for Complex Scene Generation
We present a method that achieves state-of-the-art results on challenging (few-shot) layout-to-image generation tasks by accurately modeling textures, structures and relationships contained in a complex scene. After comp…
Image GenerationLayout-to-Image GenerationObjectScene GenerationSAC-GAN: Structure-Aware Image Composition
We introduce an end-to-end learning framework for image-to-image composition, aiming to plausibly compose an object represented as a cropped patch from an object image into a background scene image. As our approach empha…
Image AugmentationObjectHetScene: Heterogeneity-Aware Diffusion for Dense Indoor Scene Generation
Generating controllable and physically plausible indoor scenes is a pivotal prerequisite for constructing high-fidelity simulation environments for embodied AI. However, existing deeplearning-based methods usually treat …
Scene Generation